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Kurzfassung 


Diese Dissertation beschäftigt sich mit der kooperativen Regelung einer mobilen Arbeitsmas- 
chine, welche aus einem Nutzfahrzeug und einem oder mehreren hydraulischen Manipulatoren 
besteht. Solche Maschinen werden für Aufgaben in der Straßenunterhaltungsaufgaben einge- 
setzt. Die Arbeitsumgebung des Manipulators ist unstrukturiert, was die Bestimmung einer 
Referenztrajektorie erschwert oder unmöglich macht. Deshalb wird in dieser Arbeit ein Ansatz 
vorgeschlagen, welcher nur das Fahrzeug automatisiert, während der menschliche Bediener 
ein Teil des Systems bleibt und den Manipulator steuert. Eine solche Teilautomatisierung des 
Gesamtsystems führt zu einer speziellen Klasse von Mensch-Maschine-Interaktionen, welche in 
der Literatur noch nicht untersucht wurde: Eine kooperative Regelung zwischen zwei Teilsys- 
temen, bei der die Automatisierung keine Informationen von dem vom Menschen gesteuerten 
Teilsystem hat. Deswegen wird in dieser Arbeit ein systematischer Ansatz der kooperativen 
Regelung mit begrenzter Information vorgestellt, der den menschlichen Bediener unterstützen 
kann, ohne die Referenzen oder die Systemzustände des Manipulators zu messen. Außer- 
dem wird ein systematisches Entwurfskonzept für die kooperative Regelung mit begrenzter 
Information vorgestellt. Für diese Entwurfsmethode werden zwei neue Unterklassen der so- 
genannten Potenzialspiele eingeführt, die eine systematische Berechnung der Parameter der 
entwickelten kooperativen Regelung ohne manuelle Abstimmung ermöglichen. Schließlich 
wird das entwickelte Konzept der kooperativen Regelung am Beispiel einer großen mobilen 
Arbeitsmaschine angewandt, um seine Vorteile zu ermitteln und zu bewerten. Nach der Analyse 
in Simulationen wird die praktische Anwendbarkeit der Methode in drei Experimenten mit 
menschlichen Probanden an einem Simulator untersucht. Die Ergebnisse zeigen die Überlegen- 
heit des entwickelten kooperativen Regelungskonzepts gegenüber der manuellen Steuerung 
und der nicht-kooperativen Steuerung hinsichtlich sowohl der objektiven Performanz als auch 
der subjektiven Bewertung der Probanden. Somit zeigt diese Dissertation, dass die kooperative 
Regelung mobiler Arbeitsmaschinen mit den entwickelten theoretischen Konzepten sowohl 
hilfreich als auch praktisch anwendbar ist. 


Abstract 


This thesis focuses on the shared control of a large vehicle manipulator, which consists of a 
mid-size heavy-duty vehicle and one or more large hydraulic manipulators. Such machines are 
used for road maintenance work. The working environment of the manipulator is unstructured, 
making the measurement of a reference trajectory challenging or impossible. Therefore, in this 
thesis, an approach is proposed, that automates the vehicle only, while the human operator 
remains part of the system and controls the manipulator. Such a shared control setup leads to a 
particular class of human-machine interactions, which has not been studied in the literature: 
Limited information shared control between two subsystems, in which the automation has 
no information about the human-controlled subsystem. Therefore, this thesis contributes a 
systematic approach to the limited information shared control, which can support the human 
operator without measuring the references or the system states of the manipulator. In addition, 
a systematic design concept of the limited information shared control is presented. For this 
design method, two new subclasses of the so-called potential games are introduced that enable 
a systematic calculation of the parameters of the limited information shared controller without 
manual tuning. Finally, in order to investigate and assess the benefits of the proposed shared 
control concept, it is applied to the example of a large vehicle manipulator. After the analysis 
in simulations, the practical applicability of the methods is investigated in three experiments 
with human test subjects using a simulator. The results show the superiority of the developed 
shared control concept over manual control and non-cooperative control in terms of both 
objective performance and subjective evaluation of the subjects. Thus, this thesis shows that 
the shared control of large vehicle manipulators is both helpful as well practically applicable to 
the developed theoretical concepts. 
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Hypothesis in the experiment number i 

Cost function of the full information shared controller 

Cost function of the limited information shared controller 

Cost function of the human 

Global objective function for the full information shared control design 
Cost function of player i 

The linear feedback gain of player i 

Axle distance of the vehicle 

Number of the measurement points 

Number of players in a game 

Riccati matrix 

Penalty matrix for the system states of global cost function. 

Penalty matrix for the system states of player i. 

Penalty matrix for the system inputs of global cost function. 

Penalty matrix for the system inputs of player i. 

Time variable 
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Symbol 
Vales 
Uveh 
To 


Description 


Inputs of player i 

The terminal cost of the ith player’s cost function. 
Velocity of the vehicle 

Initial state of the differential equation 
Cooperation state vector 

Measurable system states 

Non-measurable system states 

Output of the dynamic system 


Greek Letters 


Symbol 


QExp,i 


Description 


The significance level of the it” experiment 

Angle of the manipulator using the control model 

Orientation error of the manipulator 

The angle of the manipulator in the operating point 

Condition number of the upper estimation of DD A of the NPDG LMI 
Condition number of the matrices Q”) and QP? of the NPDG LMI 
Critical value of chi-squared distribution with degrees of freedom df and 
significance level a 

Chi-squared distribution 

Steering angles of the vehicle 

Upper estimation of differential distance between two games 
State-dependent perturbation function 

Optimization threshold of the first OPDG identification 

Upper estimation function of the trajectory error of NPDG 

basis functions vector 

Information structure of the game 

Strategic Game 

Exact Potential Differential Game 

Exact Potential Static Game 

Ordinal Potential Differential Game 


Ordinal Potential Static Game 

Manipulator reference path 

Vehicle reference path 

Eigenvalues of the matrix A 

Costate function of player i 

Joint 7 angle of the three-dimensional manipulator 

Ahite Gaussian noise 

The auxiliary matrix to compute the parameters of the cooperation state 
Differential distance between two games 
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Symbol Description 

Tend Duration of a dynamic game 

Tene The terminal time of a game 

0) Time-invariant parameter vector ofthe automation 

Ab ch Orientation error of the vehicle 

€ The nonlinear cooperation state function 

Pioy The input joystick angles 

Be) Gain matrix of the cooperation for the automation’s inputs 
SB) Gain matrix of the cooperation for the human’s inputs 


Calligraphic and Other Symbols 


Symbol Description 

u“) Control input set of player i 

U The combined strategy set ofthe players 

J The set of the players’ cost functions 

K General nonlinear control law of the shared control setup 
P Set of players 

Re Real part of a complex number 

R Set of real numbers 

Rt Set of positive real numbers 


Indices, Exponents and Operators 


Symbol Description 
arg max Argument at maximum 
arg min Argument at minimum 
(a) Variable corresponding to the automation 
D The average value (also called arithmetic mean) of 
dim Dimension of a vector 
E Estimated value of 
(h) Variable corresponding to the human 


Inverse of a matrix of function 
Generalized inverse 


leh Variable corresponding to the longitudinal model 

maan Variable corresponding to the manipulator subsystem 
max Maximum or maximization 
min Minimum or minimization 


t Moore-Penrose inverse of matrix 
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Symbol Description 
jolla The Euclidean norm of the matrix 
mii The Frobenius norm of the matrix O 
6 Variable corresponding to the overall system 
o* Optimal value 
5 Partial derivative of O by y 
sgn Sign function 
[k] Measurement of O at the smapling time tg 
T Transposed vector 
vec Vectorization of a matrix 
vech Half vectorization of a matrix 
Oveh Variable corresponding to vehicle subsystem 


gtr) Variable corresponding to the potential function/game 


1 Introduction 


The German road network covers around 229,720 km [Deu22, p. 102] including highways, mo- 
torways, and other roads, which need to be maintained regularly. These roadside maintenance 
works on motor- and highways are very time and labor-intensive. Thus, they are associated 
with a high-cost burden [Rec16]. Furthermore, the German Federal Ministry for Digital and 
Transport expects these costs to rise within the next few years [FP21, Hör21]. Based on the 
investigations of the State Court of Audit of Baden-Württemberg, the maintenance expenses can 
be estimated [Rec16]. With a reduction of approximately 10% in working time, these possible 
savings can mount up to 5,000,000 € from the yearly state budget just in Baden-Württemberg. 
Furthermore, the introduction of novel systems can have a social impact: quicker and more 
precise road maintenance works lead to less impact on traffic increasing the safety for the road 
users, see [Roo06]. Similar increases and potential savings of these costs can be assumed for 
other European countries [For06]. 


For road maintenance and verge mowing works, mobile vehicle manipulators with one or more 
working attachments are used primarily, see e. g. [MUL20, Due20]. Each working attachment 
is mounted on a hydraulically actuated manipulator to move it to the desired position. An 
exemplary vehicle setup with three manipulators is depicted in Figure 1.1. Their current 
state-of-the-art operation mode is manual control, which is complex and demanding because 


Figure 1.1: An exemplary image of a large vehicle manipulator with three working attachments. 
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the operator must perform two tasks simultaneously: Firstly, the operator has to control the 
manipulator in such a way that the roadside maintenance work (e. g. mowing, cutting, cleaning) 
is performed successfully. In particular, damage-free and time-efficient work is required here. 
Secondly, the operator must participate in regular road traffic with the vehicle. 


A common solution to relieve the operator is to divide the tasks between two persons: One 
person is responsible for driving the vehicle and a second person solely controls the manipu- 
lators. The fulfillment of both tasks happens cooperatively between the two people, and the 
communication between them is mainly verbal. The operating person tells the driver how fast 
and far away from the roadside the vehicle should be. Meanwhile, the driver provides feedback 
on the actual traffic and limitation of the vehicle’s motion. This cooperation is a continuous 
human-human interaction [Bec19, KKW*21], which is central to the quality of the work [Ost20, 
Chapter 4]. However, employing two people on one vehicle is not a preferred solution, as it leads 
to even higher costs. Furthermore, due to the shortage of skilled employees, the two-operator 
solution is not going to be feasible in the near future [Gmb16], [Ost20, Chapter 2]. 


A possible solution to the aforementioned problem could be the full automation of large vehicle 
manipulators, which can drive the vehicle and control the manipulator enabling an automated 
operation of these two subsystems [Ass94, Chapter 3]. However, the manipulator is usually 
operated in an unstructured environment, in which the reference of the manipulator is hard to 
measure or estimated based on the state-of-the-art sensory systems. Furthermore, in the case 
of hydraulic manipulators the "human operation cannot be predictably replaced by full robotic 
autonomy" [XC18]. These two facts hinder full automation of the manipulator, making full 
automation of the overall system according to SAE Level 5 [ORA20, Chapter 1] unrealistic 
under these conditions. 


Therefore, an alternative is the automation of the vehicle only, which seems to be a promising 
solution owing to the available results in the field of autonomous vehicles. In the case of an 
automated vehicle, the operator is relieved and could concentrate on the roadside maintenance 
work only. It therefore relieves the single operator from a heavy workload and creates the po- 
tential for significantly greater profitability for the operating companies and the manufacturers 
of mobile machinery and further savings for the state budget. These facts encourage increased 
research on the automation of the vehicles of such systems. Therefore, this thesis focuses on a 
novel automation solution for the vehicle itself, in which the operator still remains part of the 
system and controls the manipulator. 


1.1 Research Objectives and Contributions 


Since the cooperating behavior between the vehicle and manipulator is crucial for the quality of 
the work, the automation of the vehicle has to take the task of the manipulator into account as 
well. This is challenging for the automation because of the unstructured working environment 
and the lack the reference trajectory of the hydraulic manipulator. Therefore, the automation 
has limited information on the manipulator. Task sharing with limited information is generally 
not addressed by the current state of the art: The state of the art has neither practical nor 
methodological solutions for such a shared control setup. Thus, this thesis attempts to close 
both the methodological and the practical research gap. 


Firstly, the current literature does not provide control algorithms of vehicle manipulators 
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including a human operator, because their focus is the control of small-sized, indoor vehicle 
manipulators, see e. g. [WBK07, SK08b, MASD14, TSA*22]. Furthermore, large manipulators 
are studied only with a static base [HS10, Rud18, WWXS22]. Existing shared control concepts 
require full information on all system states and references, see e. g. [FFV 16]. Due to limitations 
in the perception of the manipulator, these requirements are not fulfilled for the system under 
consideration and thus existing shared control concepts cannot be applied. 


The lack of both practical and conceptual solutions for the aforementioned shared control 
application with limited information necessitates the development of novel shared control 
methods. Therefore, this thesis focuses on limited information shared control of systems with 
similar structures to large vehicle manipulators: The human-controlled system part is not 
available for the automation. In other words, the automation has limited information. 


Consequently, the research reported in this thesis attempts to answer the following three 
questions: 


1. How can the two tasks of limited information shared control setup be modeled? 


2. How can a model-based design of this limited information shared controller be formu- 
lated? 


3. How can the suitability ofthe proposed limited information shared controller be evaluated 
and compared to the state-of-the-art methods? 


To answer the first question, this thesis proposes limited information shared control having a 
modified model structure using the so-called cooperation state. The proposed formal definition 
enables the sharing of the control task despite limited information of the system states or 
reference trajectories. 


For answering the second question, a systematic automation design is presented, enabling a 
general transferability for further applications. The design procedure computes the parameters 
ofthe cooperation state and the necessary feedback gains of the controller. 


In order to answer the third research question, a simulator was developed in the course of the 
thesis. Using this simulator, three experiments were conducted to investigate the proposed 
limited information shared control concept and the design method. 


1.2 Outline 


The outline of this thesis is depicted in Figure 1.2: Chapter 2 presents the state of the research 
relevant to this thesis in the fields of 1) vehicle manipulators, 2) large hydraulic manipulators, 
and 3) shared control concepts and methods for human-machine interactions. The limitations 
ofthe existing concepts are discussed and the necessity for a novel approach is shown. 


In Chapter 3, the fundamentals of game theory and shared control designs are introduced, 
which are followed by the novel concept of limited information shared control and the overview 
ofthe systematic design procedure. 


Chapter 4 handles the systematic design procedure of limited information shared control in 
detail, for which the two novel subclasses of potential games are introduced. This is followed by 
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the presentation of the systematic calculation of the cooperation state and the stability analysis 
of the limited information shared controller. 


In Chapter 5, the concept of the limited information shared controller is applied to the lateral 
and longitudinal control problem of a large vehicle manipulator. Moreover, the methods and 
concepts for the developed potential games are applied and analyzed in simulations. Then, the 
limited information shared controller is verified and analyzed in simulations. Furthermore, the 
developed test bench is introduced, which includes the complex, real-time model of the vehicle 
manipulator. 


Chapter 6 presents three experiments demonstrating the benefits of limited information shared 
control and the usability ofthe design process by validating both on the test bench with human 
test subjects. In these experiments, the performance is evaluated from objective and subjective 
points of view. 


Finally, the thesis is summarized and concluded in Chapter 7. 
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Figure 1.2: The outline of the thesis 


2 Related Work and Research Gap 


The first part of this chapter presents the concepts of small and large ground vehicle manipula- 
tors. The emerging challenges are discussed and the need for considering the human-automation 
interactions in the context of vehicle manipulators is specified. Afterward, the control concepts 
and models of large hydraulic manipulators are reviewed. The diverse control modes and 
technical hurdles of their full automation in the near future are highlighted. The subsequent 
part deals with the concepts and approaches to human-automation interactions. The review of 
the related works reveals the shortcomings of the existing methods, and hence, the necessity of 
new methods is highlighted. From the identified research gaps, the contributions of this thesis 
are formulated for the shared control of large vehicle manipulators at the end of the chapter. 


2.1 Modeling and Control of Vehicle Manipulators 


This section provides a brief overview of the specific applications, the models and the control 
approaches from literature, which supports comprehending the challenges of the vehicle 
manipulators’. 


A vehicle manipulator is a robotic system consisting of a mobile base (a vehicle) and a robotic 
manipulator, which can carry out various tasks [AKO06]. In literature from the ’80s and ’90s, 
there were already models and controller methods for various vehicle manipulator systems, see 
e. g. [DV89, LL90, HD91a, MYL91, CB97, ATS98]. From the 2000s, the efforts of this development 
were even more significant, whereby numerous practical applications of vehicle manipulators 
were established, and theoretical methods were proposed, see e. g. [WBK07, ZANS06, FDGS09, 
FGP14]. Such applications involve different domains: Aerial, underwater, and ground vehicle 
manipulators, see [BK16, Chapters 51 and 52]. Some applications worth mentioning from 
literature are the following: 


e In the aerial domain, there are numerous special applications, which require active 
intervention instead of passive monitoring or remote inspection, see [RLO18]. Such 
aerial vehicle manipulators have the benefit of being able to operate under hazardous 
circumstances and protect human workers, see, e. g. [BK16, Chapter 26]. The literature 
addresses mechanical design problems [NGK15], controller synthesis, and the realization 
of real-world applications [KHS* 14]. Due to the short flying time, such systems currently 


In literature, there are different terminologies for vehicle manipulators: In the 2000s, the term "vehicle manipulator" 
was common, while in the last years, the literature has more often employed the term "mobile manipulator" 
indicating the growing number of industry 4.0 applications. Both terms are used for the description of a robotic 
system including a mobile base and (at least) a robotic arm. In this thesis, the term "vehicle manipulator" is 
consistently applied. 
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have only a few practical applications, see [OTS*22]. For further information, it is 
referred to the review articles [RLO18, MHH20, OTS* 22]. 


« Examples for the underwater domain include both remotely operated and autonomous 
underwater vehicles [BK16, Chapter 25]. Their fields of application have a long his- 
tory (e. g. [Ege91, MOM94, CODP98, ACC04]): undersea oil and gas exploration of the 
industry, military activities, or scientific and environmental missions, see, e. g. [SP01, 
MCY09, SLO*22]. Underwater vehicle manipulators have further challenges regarding 
the actuators, sensors, and their mechanical structure due to the high pressure [Hya11], 
and communication delay hampering the teleoperation, see e. g. [KSWK20]. For in-depth 
reviews, the reader is referred to [BK16, Chapter 25] and [SCO* 18]. 


As this thesis focuses on the application of ground vehicle manipulators, see Chapter 1, the 
following part presents this domain in particular. To provide an overview of ground vehicle 
manipulators, Figure 2.1 supports the discussion of the application categories. In each category, 
the limitations of existing methods are addressed and the necessity of new concepts is explained. 
Then, the models and control approaches of these applications are discussed. Finally, the 
necessity of introducing systematic definitions of dual task and task prioritization in the 
context of vehicle manipulators is explained. 


The application domains of ground vehicle manipulators are categorized into A) Industrial, B) 
Assistive, and C) Outdoor/Off-road vehicle manipulators’, see Figure 2.1. 


Industrial vehicle manipulators possess the mobility and flexibility to carry out various tasks 
such as assembling [KMAM18, HOD* 22], surface treatment processing [DYM* 22], welding 
[LWH*22, XWCH22], or transportation (pick and place) of heavy objects within warehouses 
[WFK* 16, DKK*17, ARTG19, ZSS*20]. For these industrial applications, the manipulators have 
electrical motors for the actuation of the joints. Therefore, they can move faster and more 
precisely compared to a large vehicle manipulator, which possesses hydraulic actuation, see 
Chapter 1. Furthermore, industrial vehicle manipulators are usually employed in factories 
or warehouses, where stationary localization systems can be installed [WFK*16, DKK* 17]. 
Such localization systems provide the exact pose of the vehicle manipulator and a precise, 
collision-free reference path to control them. These localization systems are not available for 
outdoor large vehicle manipulators leading to more challenging situations. Furthermore, the 
existing control concepts for industrial vehicle manipulators focus only on their full automation 
without including a human operator in the control task. However, large vehicle manipulators 
cannot be fully automated due to legal reasons and at least a supervisory human operator has 
to be present, see [Bun21]. The supervisory role of the operator leads easily to the "out-of-the- 
loop" phenomenon causing potentially dangerous situations, see [Bai83, Kom08]. Therefore, 
keeping the human operator in the control loop of large vehicle manipulators seems beneficial 
in contrast to the trends of industrial vehicle manipulators. 


? There are review articles, which arrange the ground vehicle manipulators in different categories. The groups 


chosen here can help emphasize the shortcomings of the methods with respect to the large vehicle manipulator 
for road maintenance works more precisely. 
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Aerial Underwater Ground 
Vehicle Manipulators Vehicle Manipulators Vehicle Manipulators 
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Vehicle Manipulators Vehicle Manipulators 


Manufacturing 
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C) Outdoor/Off-road 
Vehicle Manipulators 


Forestry 
Applications 
Agriculture 
Applications 


Figure 2.1: The various application domains of vehicle manipulators. 
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Hospital, Surgery 
Applications 


Due to the lack of stationary localization systems, the control of large vehicle manipulators 
cannot be solved with the concepts of industrial vehicle manipulators. Thus, novel methods 
including the human operator are necessary for large vehicle manipulators. 


Assistive vehicle manipulators can ease the life of disabled or elderly people and can e. g. provide 
support for patients in hospitals [KKP*09]. Further applications include automated wheelchairs 
with a manipulator [MASD14, DLYL*20], light-ware robots for household tasks (cooking, clean- 
ing) [BGJ*05, KECM22], or self-care robots for daily activities [HGC* 14]. Common household 
tasks, which are addressed in the development of assistive vehicle manipulators are clos- 
ing/opening doors or picking up and handing over objects, see e. g. [KECM22, KCF* 12]. In hos- 
pitals, assistive vehicle manipulators can be used for the disinfection of surfaces [HZL* 20], thera- 
peutic assistance [YTO* 19], or accompanying patients with needs for walking support [SRH22]. 
The application from literature show that assistive vehicle manipulators imply interactions 
with humans. However, their interaction concepts cannot be transferred to large vehicle ma- 
nipulators, since the nature of the interactions is different: Assistive vehicle manipulators 
support humans in everyday activities, in which the automation and the human do not control 
a technical system together. On the other hand, in a shared control setup’, the operator and the 
automation control the technical system together. Therefore, the concepts of assistive vehicle 
manipulators cannot be adapted to large vehicle manipulators. 


Outdoor and off-road vehicle manipulators can be found on construction fields, in forestry, or 
in agricultural applications, [OMS21b, CKH08, SSK17, ETKA* 19] or [BK16, Chapter 56]. The 
application of these control concepts for the problem from Chapter 1 is not possible, because 
the actual applications of outdoor and off-road vehicle manipulators have special mechanical 
structures or customized control algorithms. They are usually smaller than a large vehicle 
manipulator. They are often designed for one specific task only: Pesticide spraying, weed 
killing or harvesting on the agricultural fields [MZR* 14, BHCI20, DDT* 22]. Furthermore, in 
other works, a human operator is taken into account but only for large manipulators with a 
stationary base, see e. g. [HS10, MKK19, KMPK21]. 


3 For a formal definition of shared control, it is referred to Definition 2.4 in Section 2.3. 
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Independently of the operating domain, all the applications of these three categories have one 
feature in common: The two subsystems - the vehicle and the manipulator — have different 
kinematic and dynamic characteristics. Their combination facilitates solving novel and chal- 
lenging tasks, enabling increased manipulability and better flexibility of the end effector (EE), 
which is beneficial in many applications. In general case, the vehicle manipulator possesses at 
least nine or more degrees of freedom (DOF): The vehicle has three, and the manipulator has 
six DOF. This generates a system redundancy, which must be handled during the controller 
design. This redundancy is defined in Definition 2.1 


Definition 2.1 (Vehicle Manipulator Redundancy) 


Let a vehicle manipulator be given with the system states 


x = [2,2]; 


where ay = [xv, Yv, 0v] and £m = [q1, 93, ---) dn] represent the states of the vehicle and 


the generalized coordinates of the manipulator, respectively. The states £y, yy and 0, 
represent the vehicle position and orientation. The generalized coordinates q; are usually 
the joint angles fully describing the pose of the end effector. The vehicle manipulator 
redundancy is called the redundancy of the end effector pose, which is raised by the 
combination of the motions of the two subsystems, the vehicle and the manipulator. 


Note: 

A redundancy problem can be raised by the structure of the robotic manipulator itself (see e.g. 
robots with seven or more degrees of freedom). However, the redundancy of the robotic ma- 
nipulator itself is not explicitly addressed in this thesis as the manipulator is human-controlled, 
and because large vehicle manipulators usually have manipulators with four or five DoF. For 
further information about manipulator redundancy, it is referred to [BK16, Chapter 10] 


The vehicle manipulator redundancy allows to reach a target point in various ways: For instance, 
the target point is reached by moving the manipulator only or by coordinating the vehicle 
and the manipulator. Such coordination is often essential for complex tasks to reach time- or 
energy-optimal operation, see [Anc17, ZSS* 20]. 


A common feature of vehicle manipulators is the existence of two linked tasks for these two 
subsystems due to their physical constellation*. In the case of a vehicle manipulator, a typical 
example of two linked tasks is the tracking of two trajectories: One for the vehicle and another 
for the manipulator, see e. g. [FAD10, TMK* 11, ZKHE13, NY96, CCL10, MGF* 21]. The graphical 
illustration of such two linked tasks for a planar vehicle manipulator is given in Figure 2.2: The 
simultaneous minimization of the relative deviations to the references. These deviations are 
illustrated with the orange distances d, and dm which are defined between reference points of 
the vehicle manipulator (P,, Pm) and the two references I, and I'm. Thus, these two tasks 
are linked since they influence each other. However, there is no general definition for such two 
linked tasks in the robotic domain. 


4 Note that the issue of dealing with two tasks simultaneously is widespread. For example, the control and 


coordination of multiple unmanned aerial vehicles includes also two or more separate tasks, see e. g. [GBGKH18, 
CCS* 18, ZYZS19]. 
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Figure 2.2: A vehicle manipulator with two references in planar is illustrated leading to a dual task, which is the 
simultaneous minimization of the deviations from the references of the vehicle and the manipulator 
(Ty and I'm). This dual-task setting can lead to a trajectory prioritization problem. 


In order to find a suitable definition for the problem of dual task, other research disciplines can 
also be considered. For instance, the emerging challenges of dual task is also the subject of the 
psychological research community. There are works focusing on the mental state of the human 
during a dual task. One of the main focuses is the analysis and research of different modalities 
(visual, auditory, manual) and their compatibility effects, see [WKK20]. Other works deal with 
the predictability of the dual task performance [BEd* 21], brain activity investigation [KLPK07], 
cross effects of the dual task [JPHK14], or "cognitive demands in learning situations" in dual task 
settings [WHEB* 18]. However, the limitations of the various definitions and combinations of 
the different tasks hinder the general treatment of these research works: "[...], the current state 
of research indicates a clear lack of standardization of dual-task paradigms over study settings 
and task procedures" [EB21]. Thus, there is no formal definition for the dual task in literature in 
the domains of robotics and psychological research. Therefore, a definition for the scope of 
this thesis is given in the following. 


Definition 2.2 (Dual Task) 


If a control system has to fulfill two linked tasks with two separate goals on a vehicle 


manipulator, these two tasks are called a dual task. Both of the two linked tasks with 
separate goals have adjustable priorities and neither of them are considered as a disturbance 
to the other. 


Note 1: 

A dual task can consist of two low-level tasks (e.g. following two different trajectories [MAD16]) 
or a high-level and a low-level task (e. g. following one trajectory and analyzing the recorded 
camera pictures [SLO*22]). The two trajectories of a low-level dual task are called dual 
trajectories, see blue reference trajectories in Figure 2.2. 
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Note 2: 

Note that Definition 2.2 also characterizes the dual tasks which are investigated in psychological 
studies or robotic control problems. Furthermore, from the control engineering perspective, a 
control system can be a human as well as an automation system, see e. g. [Fla16]. 


After the presentation of the application domains and the definition of vehicle manipulators 
redundancy and dual task, the following paragraphs in this section focus on the control 
concepts of vehicle manipulators to reveal the need for new control methods including a human 
operator. 


To solve the control challenges of dual tasks, different approaches can be found in literature. In 
general, two main concepts can be distinguished: unified and modular controllers, see [TSA* 22]. 
A unified controller is one overall control system, which governs both the vehicle and the 
manipulator. When the two subsystems each have a controller, it is a modular control structure. 
These two separate controllers can still implement a coordinated movement of subsystems if 
there is some communication/cooperation between them. Therefore, the main challenge is 
managing the vehicle manipulator redundancy for a dual task, see Definition 2.1 and Definition 
2.2. 


Practical concepts from literature (e. g. [HTS00, OMA*18]) have also demonstrated that solving 
a dual task requires the coordination of the vehicle and the manipulator. The vehicle can help 
the manipulator to carry out the task more efficiently, e. g. door opening [CCL10, MGF*21] or 
the teleoperation of an underwater vehicle with a visual primary task [KSWK20, SLO* 22]. 


Furthermore, theoretical models and control methods of vehicle manipulators do not address 
the problem of dual task explicitly. Such works, for instance, are flatness-based controllers 
[TK01, TMK‘ 08], singularity-free modeling methods [FDP* 10], the motion optimization of the 
vehicle base [PF14, RXY*17], the coordinate-free geometric approach [ZZZ14] or coordinated 
optimal path planning algorithms [RXY*17, TFSG18, LHCY19, PLM* 22]. Furthermore, such 
coordination between the vehicle and the manipulator must provide a redundancy resolution, 
for which solutions are discussed in e. g. [WBK07, Anc17]. 


The applications, concepts, and control methods presented above are useful for analyzing 
the challenges of coordinating and controlling a vehicle manipulator. However, none of the 
methods and approaches from literature define the coordinated prioritization of the dual task 
for such systems. Therefore, such a notion is elaborated in Definition 2.3. 


Definition 2.3 (Task Prioritization Problem of Vehicle Manipulators) 


Let a vehicle manipulator with a dual task according to Definition 2.2 be considered. If 
there is a configuration or a situation, in which the overall system cannot (optimally) 
carry out the dual task, the vehicle manipulator has a task prioritization problem. 
If the dual task contains purely tracking tasks, (e. g. tracking two trajectories), which 
cannot be followed simultaneously due to kinematic or dynamic constraints of the vehicle 
manipulator, the arising problem is called trajectory prioritization problem. 


Note: 
A task prioritization problem is not present if both subsystems can carry out the dual task 
optimally. 
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An illustrative example of this task prioritization problem is when the vehicle manipulator 
cannot track both references simultaneously, see blue trajectories in Figure 2.2. In some works 
from literature, the use of coordination controllers was proposed, which could address and 
handle the trajectory prioritization problem, see [CVH98, MAD14, TLX*17]. However, no 
general solution was provided. Moreover, the prioritization in these works is two-valued: 
Either the vehicle or the manipulator follows its reference, but a continuous transition of the 
leading role is not possible. 


While underwater and aerial vehicle manipulators are usually teleoperated or partly human- 
controlled (e. g. [KSWK20, SSK*22]), ground vehicle manipulators are usually fully automated. 
There is no concept in literature, which handles the dual task of ground vehicle manipulators 
in a continuous human-machine interaction. Furthermore, no concepts addressed the problem 
of limited information, meaning the design of the automation, if the reference trajectories of 
the human operator are not measurable or observable. 


The practical motivation for sharing the dual task of large vehicle manipulators is the fact 
that a human operator in at least a supervisory role is crucial for the applications of large 
vehicle manipulators due to legal reasons [Bun21]. Therefore, it is also advantageous to keep 
the human operator in the control loop of a large vehicle manipulator resulting in a continuous 
human-machine interaction. Since the manipulator’s environment is unstructured, its reference 
trajectory is difficult for the automation to measure and therefore the automation has limited 
information. 


This thesis proposes a shared control concept, which can handle the challenges of limited 
information as well as the dual task of large vehicle manipulators with a human operator. 


2.2 Modeling and Control of Hydraulic Manipulators 


The following section introduces modeling and control approaches for large, hydraulically 
actuated working machines. The models and control concepts without a human operator are 
provided first, followed by a discussion of semi-automated and assisted control concepts of 
large, hydraulically actuated manipulators. Since, vehicle manipulators for road maintenance 
require the presence of a human operator, cf. Chapter 1. This section discusses the models of 
hydraulic systems in detail because they are used for the development of the simulator applied 
for the analysis of the proposed concepts in this thesis. 


Large, hydraulically actuated manipulators can be found in forestry applications [MWLH* 11, 
KBV14, FVF15, OMS21b], construction machines [BK16, Chapter 56], [YVF17] or agricultural 
usage [OMS21a, ASTZ21]. Regarding the automation of such mobile hydraulic systems, there 
are two main requirements to consider (see e. g. [Stell, HA12, MKCS17, XC18, MG21]): 


« Good dynamics, which means that the large hydraulic manipulator is characterized by 
good damping and robust and precise velocity response. 


« Energy efficiency: Hydraulic systems are inefficient, their average efficiency is around 
21%, see [Ste11, XC18]. Replacing the existing "on/off valve-controlled systems" with 
model-based controllers can increase this efficiency significantly [KZM19]. 
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To address these two requirements, having appropriate models is important to enable model- 
based control synthesis and further analysis. In recent years, there was a great effort to develop 
models of hydraulic actuators and to use them for model-based controller design, see [Rud17, 
Rud18, PR18] or [VGJ19, Chapter 2]. Depending on the model accuracy, these are used for 
optimizing the fuel consumption [GLWL20] or robust controller design [Rud18]. In this thesis, 
the two models of Ruderman are applied for the simulation and control model derivation due to 
the degrees of detail and the compact formulation provided by these models [Rud17, Rud18]. 


Table 2.1 summarizes the works related to this thesis. One of the most important challenges 
enabling the automation of hydraulic manipulators is the parameter identification of complex 
models [RAA*17, SOC21]. These systems are also characterized by a significant latency and 
dead time, which depends strongly on the temperature ofthe working oil and on other different 
factors, such as operation load, wear, or the manipulator’s configuration, see [AT20], which 
makes full automation more difficult. The implementation of model-based controllers is also 
challenging due to the nonlinearities of the overall system and the flow limitation of the 
working oil [LNM20, SS20]. For the teleoperation of these systems, the sensation ofthe load 
on the hydraulic working tool is essential. Such a load sensation implies further challenges, see 
[WWXS22]. One example of large hydraulic manipulators with a mobile base can be found 
in [KBV17]. The test environment of the vehicle manipulator was a large, flat area with no 
obstacles. Furthermore, the pose was estimated with a high-precision Real-time Kinematic 
Positioning Global Positioning System [Jef10, Chapter 4], which can provide centimeter-level 
accuracy. However, such working environments and measurement systems are rare in practical 
scenarios. Thus, the full automation of large vehicle manipulators is not entirely solved using 
state-of-the-art methods. 


Additional crucial drawbacks of the fully automated hydraulic manipulators are that they 
require a wide range of sensors to measure all necessary system states” and precise perception 
of the environment. Due to the dust and dirt in their typical working environments, high- 
fidelity sensors are not robust and reliable enough for the required accuracy. Therefore, in 
[LHMWS09, MWLH* 11, KBV14], open-loop experiments were conducted meaning that the 
references were predefined in advance. Furthermore, in [MKCS17], it is pointed out that the 
"[...] control of hydraulic actuators is still a challenge and it has not yet reached a commercial 
off-the-shelf level of maturity". Consequently, full automation of large hydraulic manipulators 
is not forthcoming in the near future and requires further research [XC18]. Therefore, such 
full automation is not considered in this thesis. If a human operator is required to be present 
on a large vehicle manipulator due to safety and legal issues, cf. Chapter 1, it is logical that 
the human operator undertakes the control task of the manipulator, which results in a specific 
setup. 


In the case of a manual control of a large hydraulic manipulator, the operator use one or two 
joysticks to control the velocity of the single joints. Therefore, this control mode is referred 
to as the single rate control (SRC), [Fra04, Chapter 5], [YM10, HS10]. The SRC is the state 
of the art and can be very complex for manipulators with multiple joints. Therefore, long 
training for novice operators is inevitable, and even experienced operators can tire quickly. To 
support the human operator, there are concepts of advanced manual modes in literature, see 


> Such system states are the flow and pressure of the working oil or the position and velocity of the manipulator. 


Furthermore, the hydraulic system is a closed one, which makes it hard to install sensors. 


2.2 Modeling and Control of Hydraulic Manipulators 13 


[HS10, FVF16]. As a result, the human operators have a shorter training time and a reduced 
mental fatigue, which helps to lower the working stress [TPF21]. Therefore, these concepts 
are often more practicable and promising, because the human operator remains part of the 
control loop. Through the application of such supported manual control modes, the two main 
requirements — good dynamics and energy efficiency - can also be reached, see e. g. [Ene10]. 


Advanced manual modes of the large manipulators can be divided into two categories: 


e Operation mode modifications. In this mode, the human operator does not control the 
single joints of the manipulator separately, but directly the EE, which is more intuitive. 
The two types of this are the coordinated rate control (CRC) and the coordinated position 
control (CPC). 


« Semi automation with haptic feedback (HF). The human operator obtains HF from au- 
tomation, which helps to avoid obstacles or optimize energy consumption. 


Using operation mode modifications(CRC or CPC), the operability of the large manipulator 
is improved, see e.g. [YM10, OSBE11]. With CRC, the joystick controls the EE’s velocity 
directly instead of controlling the single joints, leading to more intuitive control. The CRC 
does not require expensive sensory systems for the position estimation of the joints and of 
the EE, as it still has an open-loop structure. For example, in [YM10], the velocities of the EE 
are given in Cartesian coordinates enabling independent horizontal and vertical motions. The 
human operators could work with CRC more efficiently compared to SRC. Other works from 


Table 2.1: Overview of the full- and semi-automated large hydraulic manipulators with focus on the operation modes 
and application area. Abbreviations: CRC - coordinated rate control, CPC - coordinated position control, 
HF - haptic feedback 


Modes of Controller Application | Motion of 
Operation Design Focus Veh. Base 
KBV17, Rudi 
l a 1 = 1] full automation | model-based forestry x 
[LHMWS09], open-loop 
[MWLH*11, KBV14] | full automation u ovestiy . 
[KBV17] full automation | model-based forestry v 
[YVF17] full automation | model-based | construction x 
[HS10, FVF16] semi automation ans forestry x 
based 
semi automation | trajectory- : 
[Ene10, OSBE11] with HE based construction x 
traj 5 
19], 19 Re construction x 
[SLL* 19], [MRC19] CRC based 
[KB03, KKL* 09] trajectory- f 
[EB11, GWYZ19] CPC based construction x 
i : 
DPMC18] eae on data-driven | construction x 
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literature suggest the coordinated position control (CPC) mode, see e.g. [WEB15, MRC19]. 
In this mode, the human operator controls the position of the EE directly with the joystick. 
CPC can facilitate more precise manipulation. Various manipulator motions can be realized 
due to the complex haptic industrial interfaces. In [WTES87], CRC and CPC were compared 
in different scenarios and with different machines. It has been shown that the CPC is more 
accurate, generating smaller tracking errors than CRC, except for large robotic arms with slow 
dynamics. These results were confirmed in a comparative study [MRC19]. Most of the large, 
hydraulic manipulators belong to this exceptional class, which makes the CRC more beneficial 
compared to CPC, see e. g. [EB11, XC18]. 


Semi automation concepts with haptic feedback in literature provide a support based on the 
optimal reference trajectory of the manipulator [YM10, HS10]. This includes the computation of 
the geometrical distances between the optimal trajectory and the actual pose of the manipulator, 
from which the haptic feedback is calculated providing support. The optimal trajectories were 
computed beforehand and reconstructed from measurement data, see "trajectory-based" and 
"data-driven" in Table 2.1. No models of the human or the hydraulic manipulator were taken 
into account for these optimizations, see [YM10, HS10]. 


Inspired by the state of the art of large hydraulic manipulators, this thesis also uses an open-loop 
structure, in which the human controls the manipulator with improved operability by the CRC 
of the EE. Furthermore, no haptic feedback is provided for the human operator by the shared 
control proposed in this thesis. From Table 2.1, it can be seen that operation mode modifications 
(CRC, CPC) and semi-automated concepts are widely utilized in construction applications. Their 
design approaches do not include the models of either the human or the hydraulic manipulator. 
On the other hand, the approaches to the full automation of the hydraulic manipulators include 
a model, and the concepts are mostly used in forestry applications. Thus, there is no semi- 
automated or shared control concept, which uses a model of the human or the system and 
takes advantage of the motion of the vehicle base. Thus, this research gap is addressed in this 
thesis. 
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2.3 Concepts of Shared Control for Human-Machine 
Interactions 


This section presents the fundamental concepts of modeling and controller syntheses for shared 
control in literature. A definition for shared control is given, which is inevitable due to the 
different terminologies in literature. 


2.3.1 General Concepts of Shared Control 


There is much ongoing research to describe, model, and understand interactions between 
automation and human in control tasks. General concepts provide hierarchical frameworks to 
characterize human-automation cooperation or interaction. They usually have a structure with 
decision layers for the different task levels‘, see e. g. [Fla16, PF16, FAT*16, ACM* 18, RWIH20]. 
They focus on applications where one human and one automation interact with each other. 


The state ofthe art of ground vehicle manipulators and large hydraulic manipulators showed 
that these two application domains usually have low-level control tasks (trajectory tracking, 
point-to-point motions), see Section 2.1 and Section 2.2. Therefore, the following presents 
the shared control methods focusing on the execution/operation layer of the frameworks 
mentioned above. This operational layer with a coupled control structure usually corresponds 
to shared control in the state of the art. However, in [ACM* 18], the following is stated: "There 
is no single definition for shared control that is used across application domains". Several 
works from literature use the terminus shared control in different contexts. Therefore, in the 
following, further definitions of the term shared control from literature of the last decades 
and different domains for low-level control tasks are discussed, and the definition is provided, 
which is applied in this thesis. 


The core idea of the shared control was initially used for haptic support in teleoperation (see 
e. g. [Ros93, MS94, YAF*99, WLA*02]), and its use as haptic assistance executing dynamic 
tasks became widespread later, see e. g. [Tah01, GG05]. In [SG01], it has been shown for the 
first time that haptic interaction between human and automation should be characterized 
by a bi-directional information transfer meaning that haptic feedback can be used for the 
communication between human and automation. One of the very first overviews was given in 
[Tah01], in which the previous applications of shared control are summarized and compared. 
The common features are also identified, from which the general requirements for the shared 
control design are derived in subsequent works. Another literature review was provided 
in [OGGL06], which categorized haptic support into three groups: a) passive assistance for 
performance enhancement, b) passive assistance for training: record/replay, and c) shared 
control: performance enhancement and training. Additionally, the authors compared passive 
assistance for performance enhancement with shared control in two studies. In [EB10a], a 


These layers are in [FAI 19]: Strategic, Tactical, Operational Layers. On the other hand, [RWIH20] provides a 
slightly different arrangement of these layers: Decomposition, Decision, Trajectory and Action Layers. Both models 
provide the possibility to investigate human-automation or human-human interactions on higher decision layers. 
Because the number of layers are developed based on technical considerations rather than on the observation of 
human behavior, a proper choice of the layer number is always application-specific. 
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framework with six different classes of shared control was presented: 1) Traded Control, 2) 
Indirect Shared Control Through Cues, 3) Coordinated Control, 4) Collaborative Control, 5) 
Virtual Constraint and 6) Continuous or Blended Shared Control. The proposed concept of 
the blended shared control had an effect on the system continuously, which was provided via 
a human interface device, see [EB10a]. In [PO12], a novel taxonomy implementing shared 
control was suggested. The authors used their shared control terminology in the context of 
training novice operators and not with the focus on the "out-of-loop" problem, which is one of 
the key aspects of automated systems, see [WC80]. 


Further robotic applications also had different definitions. For instance, in [LY02], shared control 
was defined as the allocation of the global and local tasks between human and automation. This 
assumption is justified by the fact that humans can solve global tasks more efficiently while 
the automation is superior in local tasks. Other works define shared cooperative control as a 
situation, in which human and machine can carry out the dedicated task(s) together and alone, 
see [Fla16, Lud21]. On the other hand, shared control is in [NMG05] specified as a control 
structure, in which one of the partners (either human or automation) is not able to carry out 
the task alone properly. Their application focus was the shared control of minimally invasive 
telesurgical training. In [LZD*17], the term shared control was used as an additional reliability 
element of wheelchair control systems, interacting with human only in unsafe situations. This 
definition was used similarly in other works [TKM18, DPCB19]. In [Wad19, SSK*22], shared 
control was defined as "[...] one of the cooperative control schemes, in which humans and machines 
interact congruently in a perception-action cycle to jointly perform a dynamic task". 


Application-oriented examples from literature are the teleoperated shared control of unmanned 
underwater vehicles, see [KSWK20, SLO* 22]. These applications have similar characteristics 
to the one presented in Chapter 1: The automation supports the human by carrying out one of 
the two tasks (control of the underwater vehicle) while the human can better concentrate on 
the other task (inception with the camera). Thus, the supporting automation does not fully 
replace the human operator and the visual inception of the objects remains the task of the 
operator only. However, these applications are different: The vehicle is a submarine and does 
not have non-holonomic motion constraints. The manipulators of such underwater vehicle 
manipulators have different structures compared to large vehicle manipulators. Moreover, 
teleoperated underwater systems have to deal with high pressure and communication delay. 
Therefore, their concepts cannot be applied to the challenges of large vehicle manipulators. 


From this brief overview, it can be seen that the definitions of shared control cannot handle the 
specific problem of large vehicle manipulators from either a theoretical or a practical point of 
view. Furthermore, the large number of definitions hinders the comparability of the applications 
and the discussion of researchers. Therefore, recent works attempt to provide a standardized 
and more generalized framework and coherent definitions for the concepts of shared control, 
see [ACM* 18, FAI* 19, RWIH20]. These frameworks enable the analysis of the relationships 
between the various interpretations, such as indirect/direct cooperative, collaborative, or traded 
shared control. 


Due to the generality of the shared control definition from [ACM* 18], this thesis adapts it to 
the problem of vehicle manipulators with a human operator as follows. 


2.3 Concepts of Shared Control for Human-Machine Interactions 17 


Definition 2.4 (Full Information Shared Control) 


Consider at least one human and one automation continuously interacting in a "perception- 
action cycle." Their goal(s) is (are) to accomplish (an) operational task(s) in a dynamic 


environment. Under perfect conditions, either the human or the robot can carry out 
this task alone, because both have full information about the system states. Such a 
continuous interacting human-automation configuration is called Full Information 
Shared Control. 


Note: 

Definition 2.4 is an extension of the definition of [ACM*18]. It emphasizes that the works from 
literature assume that the system states and reference trajectories are fully measurable for the 
automation, which is generally not the case by large vehicle manipulators. 


Furthermore, both fully automated and pure manually controlled systems are excluded by 
Definition 2.4, because at least one human and one automation have to be present to enable 
an interacting cycle. Negotiation or decision-making models of e. g. [PF16, ACM*18, FAT* 19, 
RWIH20] are omitted from Definition 2.4 because a continuous human-automation interaction 
is not given in the case of these negotiation and decision-making models. Meanwhile, for some 
earlier definitions from the state-of-the-art (e. g. traded, indirect, coordinated, collaborative, 
blended, cooperative), Definition 2.4 suits well, see [EB10a]. 


Figure 2.3 presents the shared control closed-loop system structure, where one human and one 
automation act on one system based on the actual system states and the input of the other. 


In this thesis, the terminologies "partners" or "players" are interchangeably used for both the 
human and the machine in the continuous shared control interaction’. For the sake of simplicity, 
exactly one human and one machine player are taken into consideration for the scope of 
this thesis. Note that this assumption poses no restriction regarding the generalizability of 
the concepts. As suggested in [Fla16], an aggregation of the N human and M automation 


> 


Figure 2.3: The structure of a general shared control setup, where the human and the automation control the system 
together over one (or more) control interface(s). | Inspired by [Fla16]. 


essen 


7 In the context of optimization and game theory, the term "player" is often used. In the shared control technical 


terminology, the term interacting "partners" are widespread. Since, this thesis applies game-theoretic methods for 
shared control applications, both terms are used interchangeably. 
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players into two players is possible and this does not influence the controller design. It is only 
necessary that there must be at least one human and at least one automation interacting with 
each other. 


From Definition 2.4 and the structure of shared control, see Figure 2.3, the shortcomings of the 
existing methods can be emphasized: The shared control of a large vehicle manipulator with a 
human operator needs an adaptation of the existing methods due to the following reasons. 


The first reason is that a dual task setup was not investigated in literature. The effects of a 
secondary task were investigated in the context of highly automated vehicles [GG05, BM15, 
LWW'*21], however, in these studies, the secondary task was considered as a disturbance or a 
distraction and not as a task with equivalent priority. Therefore, the design and usage of shared 
control for dual tasks with trajectory prioritization is still an open question. The second reason 
for the shortcomings is the usual assumption that both partners can control both subsystems. 
This assumption does not hold for many practical applications: 


« The human operators can carry out a part of the dual-task only, because it is challenging 
or difficult for them. 


e The technical realization of the automation is very limited to well-structured environ- 
ments (like motorways) or simple tasks. 


This thesis extends Definition 2.4 for dual tasks with limited information and provides a 
systematic solution for the design of the so-called limited information shared control problems. 


2.3.2 Shared Control Design 


This section provides an overview of general shared control design methods. First, the model- 
based methods from literature are presented, followed by the data-driven approaches. Table 2.2 
summarizes the design methods from the state of the art. 


Model-based shared controller designs are approaches, in which an explicit, white-box model of 
the human partner is used for the calculation of the controller parameters. Through the design, 
the behavior of the human is taken into account inherently. Modeling human behavior in 
shared control applications has a long history: The very first works date back to the 90s with the 
application of an assistive wheelchair navigation system with adaptation, see [BLK* 94, SLB* 98]. 
Even more applications were developed in the field of human driver models in the 2000s and 
early 2010s: In [CPO06], a linear-quadratic optimal control model for the human driver was 
proposed. In [PC08], a model predictive controller is used to characterize human’s behavior. 
A two-level driver model was presented in [PE07] and an adaptation of the preview time 
of the human’s behavior was suggested in [UP05]. In [BAH*13, SRGFS19] shared control 
concepts with haptic feedback were developed to support the human operator in carrying out 
operations in a remote environment. They showed that active haptic feedback can improve task 
performance and accuracy. The focus of these works was the generation of haptic feedback. 
Due to the dual trajectories, this thesis does not have the research focus of the generation of 
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haptic feedback for the human operator of the large vehicle manipulator. Thus, these shared 
control design methods do not suit the problem presented in Chapter 1. 


Based on these models, the theory of non-cooperative differential games was used for the 
synthesis of shared control applications, see e.g. [TAT11, NC13, FOSH14a, LSC* 19, JYN*19]. 
Further examples with application on semi-automated driving can be found in literature, 
[NSP17, FFH17, SNBP19], where the authors used a mathematical model of the driver to design 
an assistive shared control system. 


Due to the complexity of human behavior, the use of complex models is widespread, which 
impairs manageable parameterization and the general usability of model-based methods. To 
handle the complexity of human behavior, learning of the shared controllers directly from 
measurements and interaction with the human partner is a promising solution. Machine 
learning methods have been on the rise due to their good applicability and generality for 
different applications, like the design of shared control. These methods are called data-driven 
shared control and use general models (e. g. neuronal networks) or simplified system dynamics’, 
see e. g. [EB10b, DP14, BAMA20, YZC22] to reproduce the behavior that is learned from the 
human. That way, the physical relationships do not have to be determined by modeling the 
interaction or the system dynamics. The literature includes promising examples in the robotic 
domain. In [DS13], one of the first studies was conducted showing the benefit of the adaption 
and learning of the automation in a human-machine interaction. Adapting the automation 
can also be used for dynamically adjusting human authority, see e.g. [GJA17, BAMA20]. 
This is followed by further works, where the system models [BMA17] or the other partner 
[KTFH20] are determined using learning methods. These data-driven shared control concepts 


Table 2.2: Overview of the existing shared control design concepts with focus on the number of the input devices and 
availability of the system information. 


Number of the Number of | Information : 
: . RE Design Procedure 
input devices References availability 
L Vehicl limited 
O two two or more En an model-based 
[TAT11, NC13] se EM 
EBENE] (steering wheel) => information model based 
[SNBP19, JYN’ 19] 
full 
[FOSH14a, LSC* 19] general (N) general (N) ee model-based 
[NSP17] full data-dri 
[SNBP19, FFH17] one 322 information be 
[GJA17, BAMA20] Bue ed full adaptive 
[DP14, DS13] information data-driven 
full 
13, 1 one wit one d E i model-based 
BAH*13, SRGFS19 h HF 
information 
8 Simplified dynamics mean that the choice of the system states are inspired by the physics, meanwhile the dynamics 


are learned from the measurement data directly, see e.g. [BAMA20]. The reason for this procedure is that system 
dynamics are often complex or not known for the controller design. 
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and approaches could be useful in general. However, they are often not suitable for the specific 
application of vehicles in regular traffic due to issues with testing and admission, see [Bac18, 
Chapter 7] or [Kön22, Chapter 5]. Therefore, the shared control design of this thesis is based on 
model-based approaches. 


In order to illustrate the shortcomings of the general state-of-the-art shared control meth- 
ods, Table 2.2 is taken into account: In its first line, the characteristics of the large vehicle 
manipulator are given. There are usually two input devices: A joystick and a steering wheel. 
Furthermore, there are two reference trajectories and the automation of the vehicle has only 
limited information about the reference trajectory of the manipulator. 


As from Table 2.2, general frameworks are not suitable for the limited information problem 
of large vehicle manipulator, since the automation needs full information on the system state, 
which is not given in the case. Consequently, such a specific setup of large vehicle manipulators 
was not handled in literature: Neither theoretical frameworks nor practical applications exist, 
which would be suitable for their shared control. Therefore, novel methods are necessary for 
the application of large vehicle manipulators, which are addressed in this thesis: The shared 
control of systems with multiple input devices and multiple references, in which the automation 
has limited information only. 


2.4 Research Gaps and Contributions of the Thesis 


From the presentation of the state of the art, it is ascertained that large vehicle manipulators 
represent a particular system class due to the shared control and the dual task setting, which is 
however not addressed in literature: There exist neither practical approaches nor theoretical 
methods for this system class. Therefore, the extension and application of shared control 
methods to problems with dual task are necessary. Furthermore, in literature, large vehicle 
manipulators with moving bases have not yet been not treated in depth. Consequently, a novel 
shared control model is essential for the dual task problem in the context of large vehicle 
manipulators enabling a model-based controller design. 


An additional research gap is the lack of systematic handling of limited information in shared 
control applications. In the state of the art, it is assumed that the system states and the reference 
trajectories are either fully measurable or observable. However, the special setup of the large 
vehicle manipulators reveals a real-world application, which violates these assumptions. No 
shared control synthesis exists which can address the problem of states and references being 
unavailable in the context of shared control. 


Finally, enabling the testing and comparison of the proposed concepts with state-of-the-art 
methods, a test bench is required on which the elaborated assistant system can be tested and its 
usability can be demonstrated. Such a simulator with open architecture does not exist: neither 
as an open-source project nor as a commercial product. These gaps in the state of the art lead 
to the following three research questions and the respective contributions of this thesis. 
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Research Question 1 


How can a human-machine shared control for dual task problems be modeled, in which 
the automation has limited information about the human’s goals and references? 


Contribution 1 


First, this thesis introduces the concept of limited information shared control, which provides a 
novel model of a continuous human-machine interaction by introducing the so-called coopera- 
tion state. Using the cooperation state leads to a system representation, which can characterize 
the shared control setup between the human operator and the automation ofthe vehicle without 
information about the human-controlled subsystem. The proposed modeling approach differs 
from the existing methods in the state of the art by the assumption that a subset of the system 
states are not available for the automation. The core idea of the limited information shared 
controller is, that the human actions are used to construct the cooperation state. Thereby, the 
automation design by means of this novel model leads to a feedback controller that can facilitate 
the handling of large vehicle manipulator systems in which the human operator controls the 
manipulator and the automation drives the vehicle. Furthermore, due to the general formula- 
tion, the concept of limited information shared control is transferable to further application 
owing similar information structure. 


Research Question 2 


How should the control synthesis of the limited information shared control be formulated 
to facilitate a constructive, model-based design method? 


Contribution 2 


The second contribution of this thesis is the development of a systematic automation design for 
the proposed limited information shared control providing the parameters of the cooperation 
state and the feedback controller. The design includes four steps: The first step is the design 
of the corresponding full information shared control, cf. Figure 2.4. The second step is the 
application of potential games to model the human-automation shared control setup, which 
provides a more compact, substituting model of the shared control setup than full information 
shared control. Since none of the current subclasses of potential games are suitable to model 
human-machine interaction generally, two novel subclasses, near potential differential games and 
ordinal potential differential games, are introduced. Methods to compute these two subclasses 
are developed to find a potential game for a given differential game. The third step is the 
calculation of the parameters of the cooperation state based on the optimality condition. In 
the fourth step, the controller parameters are determined through optimization using behavior 
matching. The use of the proposed automation design procedure enables the generalization of 
limited information shared control. 
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Research Question 3 


Are there any practical benefits of the limited information shared controller and its design 


procedure with respect to Research Question 2 with the developed model of Research 
Question 1 in a real application of large vehicle manipulators compared to the current 
technical solutions? 


Contribution 3 


In the course of the research for this thesis, a simulator’? was developed for the evaluation 
ofthe proposed control concepts. Three experiments were conducted indulging human test 
subjects, which provided the first promising indications that the limited information shared 
control concept supports and reduces the mental load of the human operator in real-world 
applications. 


The motivation of the first experiment is the attempt to answer whether the limited information 
shared controller can support as effectively as the full information shared controller the lateral 
motion of the vehicle manipulator. In addition, the limited information shared controller is 
compared to a non-cooperative lateral controller taking into account as a possible solution 
from the current state of the art. 


The second experiment was conducted to compare the proposed limited information shared 
controller with the state-of-the-art fully manual control of the large vehicle manipulators for 
the lateral motion. An important difference in this experiment was that no explicit trajectory 
is given to the test subjects in advance, so they had to determine the ideal trajectories online 
during the task execution. 


On the other hand, in the third experiment, the concept was applied to the longitudinal 
guidance of large vehicle manipulators, which represents an agricultural application. In the 
case of a longitudinal limited information shared controller, the human operator controls 
the manipulator mainly parallel to the driving direction, while the automation controls the 
velocity of the vehicle. The proposed limited information shared controller was compared with 
a longitudinal non-cooperative controller of the vehicle. The experimental results also imply 
the transferability of limited information shared control to other robotic applications. 


° Note that the expressions "test bench" and "simulator" are used interchangeably. 
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The contributions of the upcoming chapters and their relations to each other are depicted 
in Figure 2.4. Chapter 3 introduces the concept of limited information shared control. In 
Chapter 4, the steps of systematic controller design using the two novel subclasses of potential 
differential games are introduced in detail. Chapter 5 presents the application of the limited 
information shared control and full information shared control to a large vehicle manipulator in 
simulations. Furthermore, the qualitative analysis of the developed simulation models and the 
hardware- and software components of the simulator are presented as well. In Chapter 6, the 
three experiments with human test subjects are introduced and their results are discussed. 
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Figure 2.4: The contributions of the thesis are given, with the corresponding chapters providing an overview of the 
basic ideas and their relations. 


3 Limited Information Shared Control 


The development of limited information shared control (LISC) is based on the cooperative 
shared control design of [FOSH14a], which is introduced in the first part of this chapter. 
Non-cooperative differential games have been used to model shared controls in numerous 
applications [TAT11, NC13, FOSH14b, LSC* 19, JYN*19] and studies have shown the validity 
of this modeling approach [BOW09, LSB21, NC22]. Therefore, this thesis uses the same notion 
for modeling shared control. 


Firstly, the preliminaries on game theory are presented. Then, the shared control concept of 
[FOSH14a] is introduced facilitating the use of the notations and the definitions for the latter 
derivations. This shared controller is referred to as full information shared control (FISC), since 
its use requires full state information of the controlled system, cf. Section 2.3. 


The second part of this chapter introduces and formalizes the novel concept of the proposed 
LISC to answer the first research question elaborated on in the previous chapter. In contrast to 
[FOSH14a], this work considers more realistic scenarios, in which the automation has no system 
state information on the human-controlled subsystem. In the subsequent, such a scenario is 
referred to as limited information case. Systems with a non-measurable subsystem can benefit 
from the use of LISC especially: It enables the sharing of the control task between human and 
automation, even in the case of limited information. Finally, the motivation and the overview 
ofthe design procedure are presented including four design steps. 


3.1 Shared Control Method with Full Information 


As FISC is based on game-theoretic modeling of the human-automation system, the fundamen- 
tals of game theory are introduced, which are crucial for the subsequent presentation of the 
novel concepts in Section 3.2. Afterward, the important special case of a linear quadratic FISC 
is summarized as a basis for the introduction of LISC. 


3.1.1 Preliminaries on Game Theory 


Game theory is a mathematical discipline that describes and analyzes situations, which re- 
quires strategic decision-making (called games) with rational decision-makers (called play- 
ers). In contrast to classical optimization theory, game theory considers multiple, individual 
decision-makers, so that the outcome for the decision-makers does not only result from their 
own decisions but also from the decisions of the other decision-makers. This characteristic 
can lead to complex decision-making processes, see e. g. [Eng05, Chapter 7]. More detailed 
introductions can be found in [BO98, Eng05, Bar11, Tad13]. 


26 3 Limited Information Shared Control 


This thesis considers a strategic game ([Tad13, Chapter 3], or [LCS16, Chapter 1]) as follows: 


Definition 3.1 (Strategic Game [LCS16]) 
A strategic game I is defined by the tuple 


D={P,7,U}, (3.1) 


where N independent players denoted by the set P := {1,..., N} choose a strategy u) € 


UČ). The action set U includes all possible actions which are chosen by the player i. 
The choice of the applied action is based on the optimization of a cost function 


J® :U >R, 


where U =U x ...x UN) symbolizes the combined strategy set of the players. The set 
of the players’ cost functions is denoted by J = {J®, rr JM} ; 


Note: 

In literature, J () is also referred to as utility function, which is to be minimized or maximized. 
In this thesis, the problems are formulated without loss of generality such that the optimizations 
are always minimization problems. 


The goal of each player is to choose a strategy that corresponds to the optimum of their own 
cost functions. As, this decision-making depends on the other players as well, a strategic game 
leads to a coupled optimization such that 
min JO (u® uO), vieP, (3.2) 
ul 
where ~i denotes all the players excluding player i. If players compute their strategies and 
act only once, the game is static. On the other hand, if the game is repeated more than once 


and the players can update their strategy, the game is dynamic. Engineering applications often 
feature dynamical characteristics, which are modeled by dynamic systems. 


Definition 3.2 (Dynamic System [BHZ16]) 


A dynamic system is completely described by an ordinary differential equation and its 
initial value 


a(t) = f (t, E(t), ul (t),...,u (4), te [0, Tena] (3.3a) 
«(0) = £o, (3.3b) 


where the system function f : R* x R” x R”! x ...x RP” > R”. The state vector and the 
inputs of the players are represented by a(t) € R” and u(t) € RPi,ie P, respectively, 
The function f is continuous over t € [0, Tena] and Lipschitz continuous for u® (t) € P 
and x(t). The differential equation (3.3) is called the state space representation of a 
dynamic system. 
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If the players interact with a time-discrete dynamic system (3.3) and are only able to update 
their inputs in discrete time steps, the game is called a difference game and in case of continuous 
updates, the strategic game is called a differential game. 


The preferences of the players are modeled by the cost function 


J (a(t), uP (t), -u (E), Tena) = VO (3.4) 


Tend 


+f 9 (t, e(t), w(t), uO (t) dt, 
0 


which is defined over the duration of the game [0, Tena] with VARA and h”) denoting the 
terminal and the instantaneous cost, respectively. Using the strategic game Definition (3.1) and 
the definition of dynamic systems (3.3), differential games can be defined as follows: 


Definition 3.3 (Differential Game [BHZ16]) 
A Differential GameT 4 is defined as a tuple of 


e a set of playersi € P, 

e a dynamic system as given in Definition 3.2, 
the joint set of control strategies of the players U =U x..xuN), 
the set of the players’ cost functions J = {J™, ..., J®?)}, cf. (3.4), 


an information structure y“ (t,-). 


There are two main solution strategies to find the optimal inputs wu” ": The cooperative and 
the non-cooperative games. In a cooperative game, the players can explicitly communicate with 
each other before the decision-making and therefore cooperation (collaboration) is possible. 
On the other hand, in a non-cooperative game, there is no such communication. As there is no 
time for explicit communication in a low-level shared control setup, using cooperative games to 
model these situations is impractical. Therefore, the following focuses on the non-cooperative 
game theoretic methods only. Further explanations for choosing non-cooperative games are 
presented in Appendix A. 


The information structure of a game y“ can be open-loop or closed-loop. The differences are 
depicted in Figure 3.1: In an open-loop structure, the actions of the players depend on their 
cost functions and the initial value of the game 


u(t) = 7 (t, x0). 


In a closed-loop information structure, the players update their control signals based on the 
actual system states 

uO (t) = 7 (t,æ(t)), 
which depends on the actual system states and their cost functions, but not on the initial condi- 
tion. Thus, a closed-loop information structure enables the handling of model uncertainties. 
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Figure 3.1: Open-loop (a) and closed-loop (b) structures of differential games 


This thesis assumes a closed-loop information structure, which is more robust against model 
uncertainties and disturbances. For further information on open-loop problems, it is referred 
to [Eng98] or [Eng05, Chapter 7]. 


To find a solution to a differential game, the coupled optimization problem of (3.2) needs to be 
solved. A widely used solution strategy is the so-called Nash equilibrium, in which the players 


act simultaneously without explicit communication”. 


Definition 3.4 (Nash Equilibrium in Differential Games [BO98]) 


The game is in a Nash equilibrium (NE), if the players cannot deviate from their actual 
strategies without increasing their costs 


JO (a 9”) < Jo (a? a”) VieP. 


For differential games, the NE is the combination of the admissible strategies of all players and 
the system state trajectories of the game. This combination implies that the costs of the players 
are the function of the time-dependent system and input trajectories 


JO (ul GQ) G2). 


Computing the NE of differential games requires the coupled optimization of J‘ with respect 
to the system dynamics leading to the optimal control strategies of the players 


u(t) =argmin J (a(t), uO (t), u E), Vie P (3.5a) 
uli) 

w.r.t. &(t) = f (t,a(t), uw (t), u (t)) , t € [0, Tena] (3.5b) 
«(0) = Tio: 


10 Further solution concepts (also called equilibrium concepts) are the so-called Stackelberg equilibrium [vS*52] and 


the Pareto optimum [Par14]. The Pareto optimum of a game is a cooperative solution, in which the partners 
communicate to reach a common goal (e. g. social efficiency, overall welfare). In the Stackelberg equilibrium, the 
partners act sequentially: There is a leader and a follower, who act one after the other. The sequence of these 
interactions leads to the Stackelberg equilibrium. These two solution concepts are not the focus of the thesis, 
therefore, they are presented in Appendix A. For more detailed information about them, it is referred to [HKZ12, 
Chapter 2]. 


3.1 Shared Control Method with Full Information 29 


As discussed in Section 2.3 and in the introduction of this chapter, non-cooperative differential 
games are widely used in the modeling of shared controls, cf. [TAT11, NC13, FOSH14a, LSC* 19, 
JYN*19]. Strong evidence for this modeling approach was presented in [BOW09], where it 
has been shown that a haptic interaction between two humans (and consequently between a 
human and an automation, too) can be modeled as a non-cooperative differential game, and 
the resulting motion corresponds to a NE of this game. This finding has been validated in 
recent applications, see [LSB21, NC22]. These practical findings prompt the application of the 
mathematical tools of game theory for the design of shared control systems. 


3.1.2 General FISC Approach 


A model-based design of a shared control system requires a model of the human partner, 
see Section 2.3. Therefore, the following presents the model-based shared control design 
based on [Fla16, Chapter 3]. A widespread hypothesis for the modeling of the human’s action 
is that the humans use a cost function, which models their preferences, to compute their 
actions. Therefore, an optimal controller as a human model is commonly used in literature, see 
[Hap92, TJ02, Tod04, Av10, WDZ* 20]. Following these research results, this thesis assumes 
that human movements are the result of the dynamic optimization problem 


u™” (t) = arg min J (x(t), Tena, uw (t)), (3.6a) 
uh) 
w.r.t. f(t,a(t),u™(t)), t€ [0, Tena], (3.6b) 
x(0) = Zo, 


where f(t, x(t), u\™)(t)) represents the dynamics of the system with which the human in- 
teracts. The cost function J‘) (.) can model different behaviors of the human, which can 
be e.g. time and/or energy optimality, effort minimization, or other comfort objectives, see 


e. g. [TJ02]. 


After [Fla16], the design of a shared control means that for a high-level requirement and a given 
human model, the overall behavior of the control loop is adjusted by an appropriate design 
of the automation. The shared control setup of the automation and the human is modeled as 
a non-cooperative differential game!!. To provide a mathematical description for the design, 
these high-level requirements are condensed in a global objective function 


J) (x(t), Tena, U(t)) , (3.7) 


which has an optimum corresponding to the global preferences, see [Fla16, Chapter 3]. In (3.7), 
u(t) = [u® (t), w™ (t)] denotes the overall system inputs comprising the inputs of both the 
automation and the human. Using the optimal control law of the human (3.6) and the high-level 
requirements (3.7), a systematic design of a shared controller is possible: Firstly, the designed 


11 Such requirements can originate from higher management levels, from customers or from users in businesslike, real 


applications. Determining the most suitable function for practical problems can be challenging, because a suitable 
conceptualization of these high-level requirements is not easy especially for large, multi-variable systems with 
multiple adjustment possibilities. Consequently, the optimum of the global objective function may not correspond 
to the desired preferences. For more details, see [Fla16, Chapter 3]. 
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automation strives to a NE of the game with the human. Secondly, the design allows to choose 
the NE that corresponds to the optimal value of .J‘2). To this, the behavior of the automation is 
modeled as a cost function 


uw)" (t) =argmin J® (a(t), Tena, u(t), u(t), (3.8a) 
wl) (t) 
w.r.t. f(t,a(t), uw (t),u™"(t)), te [0, Tena], (3.8b) 
xz(0) = £o, 


where the actions of the human are taken into account in the cost function. From a mathematical 
point of view, the interaction of the human (3.6) and the automation (3.8) forms a differential 
game with two players. The NE of this game can be computed according to (3.5). 


The computation of control inputs of the automation happens with a coupled optimization 


u(t) =argmin J (t, rena, @(t), w(t), u(t), (3.9a) 
ula) (t) 
wart. &(t) = f (t,a(t), u (e), u@"(t)), te [0, Tena], 
xz(0) = £o, 
w.r.t. (3.9b) 


u®"(t) =argmin J® (t, Tena, x(t), u(t), u™ (2), 
ul) (t) 
w.r.t. &(t) = f (t,a(t),u (t),u (2), te [0, Tena], 
xz(0) = £o, 


which leads to the optimum of the high-level requirements given in (3.7) and the NE of the 
game. The computation of (3.9) requires a solution of the coupled dynamic optimization of J‘ 
with respect to the optimal solution of the human. Thus, an efficient computation of (3.9) is 
often unavailable for practical engineering applications, see [BHZ16] or [Fla16, Chapter 3]. 


For practical applications, a specific assumption of the cost function’s structure 
ao öl m oO p(t a(t), wu, wh) (3.10) 
0 


can reduce computational complexity'?. In (3.10), 6 is the time-invariant parameter vector 
and ® is the basis functions vector, see e. g. [MTL10, JKL*19, IBM*19]. In this case, (3.9a) can 
be simplified to a static parameter optimization. Computing the solution to this optimization 
problem requires less time but provides only an approximate solution of the NE due to the 


12 Using basis functions to compose an objective function to reduce computational complexity is a common procedure 


in machine learning applications as well, see e. g. [KVML18]. 
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approximation (3.10). The optimization problem 


6)" = argmin J (t, Tena, L(t), U (t),u™ (2), 0) (3.11a) 
g(a) 
w.r.t. 
u" (t) =argmin J (t,7ena,ae(t), w(t), u™ (t)), (3.11b) 


ul) (t) 
w.r.t. &(t) = f (tet), u(t), u(t)), te [0, Tena], 
(0) = xo, 
and 
u®"(t) =argmin J (t, Tend, L(t), u(t), uP), o) , (3.110) 
ul) (t) 
w.r.t. &(t) = f (tat), u(t), u (E), te [0, Tena], 
x(0) = xo, 


provides the parameters of the shared control 6, which approximates the corresponding 
NE of the game. For general non-linear systems, the computation of the closed-loop NE is not 
straightforward: It is possible to have no solutions, only unique solutions or many solutions, 
which in some cases cannot be calculated [Eng05, Chapter 8]. Thus, the design of a general 
FISC raises further challenges. However, a linear system model and quadratic cost functions of 
the players can model many engineering applications sufficiently well, which is addressed in 
the next section. 


3.1.3 Linear Quadratic FISC 


This subsection presents a specific case of FISC, in which the problem is modeled as a linear- 
quadratic (LQ) differential game’’. This approach provides an analytical solution of FISC. The 
computation of the control law for LQ case facilitates a real-time solution of this game-theoretic 
design of a shared control system. Furthermore, practical engineering problems can often be 
characterized sufficiently with such LQ models, see e. g. [NC13, FOSH14a]. 


First, a linear, time-invariant system dynamic 


f(t) = Aw(t) + X BOu (4) (3.12) 


ie 


is assumed for (3.3), where A and B“) are the system state and the input matrices, respectively. 
The global objective function is formulated as a quadratic function of the system states and 
inputs 


1 fen MES 
J® == i) * a(t)’ Q@a(t) + Y uM (t) RE) uM (t) dt, (3.13) 
0 jeP 


13 This subsection is based on [Fla16, Chapter 4]. 
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where Q(9) and R‘2) are the penalty matrices for the system states and system inputs, 
respectively, which are derived from the high-level requirements. The matrices of the ob- 
jective function (3.13) are assumed to be diagonal’, Qí) = diag[q; © „aĝ, eh qs], R) = 

( y rf ) pfs) 
diag[r}”’, 73°), T Np] 


(ieP = h}) are also modeled as quadratic functions 


. Analogously, the cost functions of the cnn and the human 


> 1 fTen eo 
JO == f * 2(t) QMx(t)+ Y u(t) ROD u(t) dt, ie P, (3.14) 
0 JEP 


where Q“) and RČ?) represent the penalty matrices for the system states and system inputs of 
the Inn i. Itis assumed that the matrices of the cost functions have a diagonal structure Q = 
diag[q‘ Dg, og qs], RW) = diag[r(”, 7d) en rid], These matrices are positive semi- 
definite and positive definite, respectively. To formulate the necessary optimality conditions, 
the Hamilton function is defined, which can be derived from the variational principle (see 
[Eng05, Chapter 8] for more details). In LQ games, the Hamiltonians of the players are 


HO = Sa(t)"Q (2) p(t) + Zu) RED uD + OTH FE),  @.15) 
jeP 


where A(t) is the costate variable. Assuming an infinite time, Teng > 00, the optimality 
condition for the player i is formulated as 


OHO (t) | 

u” 0, (3.168) 

N. a3 Oy (3.16b) 
x(t) = f(t). (3.16c) 


Substituting the Hamiltonian (3.15) and the linear system dynamics (3.12) into (3.16) leads to 


0=R™ u(t) + BOTA (t), (3.17a) 

A (t) = -QMa(t) - AA (8), (3.17b) 

&(t) = Aa(t) + >> BOu (t), (3.17c) 
ieP 


which hold Vi € P. Solving for u in (3.17a) leads to 
u(t) = RE" BOTYO (H, (3.18) 
which can be inserted in (3.17c) 


r(t) = Az(t)- > BO (RO BOTAO) (3.19) 
ieP 


14 This is a common procedure in optimal control theory, since matrix elements outside the diagonal represent mixed 
terms in the cost function that are in general not interpretable, see [BH18]. 
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The equations (3.17b) and (3.19) form a boundary value problem. Due to the fact that the second 
order necessary condition is automatically fulfilled 


H(t) 


dua? BEN, 
u 


the solution is the minimum of the cost function J. To solve the boundary value problem, a 
linear solution 


AO (t) = PO x(t) 


is assumed, where P € R”””. This leads to 


0 (aro +POA+QO- Y POSMPO) 
iP 
SRE te POsPO a(t), VieP, (3.20) 
JEP jeP 
where SO -BØRUD Ba" jeP, 
SCD BORG)" RARID BO" jep izj. 


The equation (3.20) is called the coupled algebraic Riccati equation, which can be solved more 
efficiently than the general case cf. (3.9). With the resulting P™, the feedback gains of the 
players can be computed as 


KO = RT BOTPO, (3.21) 
which leads to the feedback control of the players 
w(t) = -KË x(t). (3.22) 


The NE of the differential game is associated with the feedback gains of the players K) 
leading to the optimal trajectories in contrast to the open-loop case, in which the optimal 
control trajectories of the players are explicitly given as a function of the initial system states 
u (t, £o), see [Eng05, Chapter 7, 8]. The feedback control law (3.22) enables the support of 
the human, see [NC13, FOSH14a]. 


For practical applications, it is sufficient to compute an approximation of the NE of the differ- 
ential game including a predefined structure of the cost functions. Therefore, it is a feasible 
assumption that the global cost function is quadratic, cf. (3.13). Thus, the parameter vector of 
the automation is chosen as 


9 = la”. gs, coe gm, ra), D ae rie?) eee F (3.23) 
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which is subject to be determined. The optimal parameter vector ofthe automation is computed 
by the nested optimization 


0%” = argmin J‘) (Erai 2(t), u A), u(t), 9) (3.24a) 
gf) 
w.r.t. Vie {h,a} 
0=ATPO +POA+ QO -Y POSMPY) (3.24b) 
jeP 
= PO GMP 4 £ PASM PD) | 
jeP jeP 


which is solved iteratively. There are computationally efficient implementations of solvers for 
(3.24), e.g. in Matlab [BH18] and in C++ [GJ*10]. 


3.2 The Concept of Limited Information Shared Control 


After the presentation of FISC, the concept of LISC is introduced. In several practical applica- 
tions, FISC cannot be utilized due to the following two reasons: 


e It is not always possible to identify the human’s cost function (3.6); therefore it may not 
be available for the controller design. 


« The references’ of the human and/or the human-controlled system states may not be 
available for the automation. The reason for this can be 1) a lack of sensors due to cost 
reduction or 2) the technical impossibility of measurement (e. g. the lack of localization in 
deep ocean applications [PSSL14] and large hydraulic manipulators in unstructured and 
dusty working environments, where sensors are not reliable, [HD91b], [MWLH*11]). 


These practical challenges limit the use of the shared control approaches presented in Section 3.1, 
for which LISC provides a remedy. 


Before presenting LISC, it needs to be noted that in the state of the art, there are numerous 
stochastic models and controlling approaches for cooperative systems, which use similar terms, 
e.g. limited or incomplete information, [RSV04, MASM05, She18, KTFH20]. Other works in 
literature, e. g. [BMA17, BAMA20], attempt to design shared controls for unknown system 
dynamics, parameters, or unidentified human behavior, which is not the focus of this thesis. 
It is essential to note that the proposed model is deterministic and assumed to be known 
or identified in advance. The terminology limited information means that a subset of the 
references and system states are only available for the human, but not for the automation. Such 
a setup has not been taken into account by works with the terms limited and incomplete, see 
e. g. [RSV04, MASM05, She18, KTFH20]. Note that the terms measurable and non-measurable 
are always considered with respect to the automation. The concepts and results in the following 
subsections have been published in two research papers [VSL* 20, VIH22]. 


15 More generally, the term goal would be more reasonable because the human defines a goal trajectory or path, 


which he/she tries to reach. The term goal can precisely point out that these references are determined by the 
human online during the task execution. However, for the sake of consistency, the term reference is used. 
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3.2.1 Modeling Assumptions 


First, general assumptions are stated, which are necessary for applying LISC. 


Assumption 3.2.1 


First, it is assumed that the system model is available and input-affine. Furthermore, its 
parameters are identified in advance. It has the general form 


w(t) = f (t,2(t)) + Y g” (tæt) u (t), (3.25) 


ieP 


where the unforced state dynamics and the nonlinear input vector are f : R* x R” > R” and 
g® : Rt x R”! > R”. Furthermore, x € R”, u e R”: with i € P = {a,h} are the system 
states, inputs of the automation and the inputs of the human, respectively. 


Assumption 3.2.2 


It is assumed that the dynamic system can be split into an automation-controlled (a(t) € R"*, 
measurable for the automation) and a human-controlled part (nm € R*, non-measurable for 
the automation!®) for LISC, such that 


a(t) =[x1,(t), O]. (3.26) 


It is additionally assumed that the dynamic system is characterized by unidirectionally coupled 
dynamics”. This means that the human-controlled, non-measurable states £nm have no 
influence on the automation-controlled states £m. On the other hand, the measurable system 
part has an influence on the non-measurable system part. Therefore, the system states can be 
split into 


Em(t) = f m(t, am(t)) + I (t, Em(t)) u (2), (3.27a) 
®um(t) = fnm(t, Enm(t), Pm (t)) (3.27b) 
+92 (t, Eam (t), Era (t)) u(t) + JE (t, tam (t), 2m (t)) w(t), 

y(t) = m(t). (3.27c) 


Works in literature utilize the assumption of unidirectionally coupled dynamics, too, meaning 
that some system states have an influence on other system states but not conversely, see 
e. g. leader-follower tracking with limited information [YYF22], battery energy storage manage- 
ment with limited information [ZZLW19] or general synthesis for distributed control systems 
with asymmetric information structure [LL11, MMRY12, LL15]. 


16 Note that the terms human-controlled and non-measurable can by used interchangeably since they owe the same 


meaning in this thesis: The subsystem is meant, which cannot be measured for the automation and controlled by 
the human. 

In [VSL* 20], the terminology unidirectionally coupled motion was first used, which was introduced explicitly for 
the application of a vehicle manipulator. In the course of this thesis, this novel term is utilized, emphasizing the 
suitability of the characterization for general shared, cooperative as well as distributed control systems. 
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Assumption 3.2.3 


Finally, the continuous human-automation interaction forms a LISC, which is defined as 
follows. 


Definition 3.5 (Limited Information Shared Control [VSL*20]) 


Consider full information shared control between two partners as introduced in Definition 
2.4. If one of the partners has no information about 


a) the other partner’s references or 
b) the control strategy of the other partner or 


c) subset of the system states 


the shared control is called limited information shared control. 


Note that this definition does not fulfill the shared control Definition (2.4) because the partner 
with limited information is not able to carry out the task without the support of the other 
partner. Thus, both partners are necessary to accomplish the task, in contrast to a general FISC, 
where both partners can complete the task individually. The following definition extends LISC 
to problems with dual tasks. 


Definition 3.6 (Limited Information Shared Control for Dual Tasks) 


Let limited information shared control and dual task according to Definition 3.5 and 


Definition 2.2 be given. If the task is shared between the interaction entities meaning that 
one of the tasks is carried out by one entity and the other task by the other entity, the setup 
is called limited information shared control for dual tasks. 


The remaining question is how to design a shared control for such setups with limited informa- 
tion, which is addressed in the next subsection. 


3.2.2 System Structure with Cooperation State 


In the following, the core idea of modeling with the so-called cooperation state (CS) is proposed, 
which is used for the design of LISC with dual tasks. It is assumed that the design procedure is 
carried out in a full information setup and controller parameters of LISC are obtained. Then, 
the subsequent usage of LISC can be realized also in setups with limited information. Figure 3.2 
illustrates the design procedure and the usage of the controllers under these assumptions. The 
reason for this assumption stems from practice: LISC is designed in an artificial environment 
(e.g. testing area or simulation environment) where the use of FISC is possible as well since all 
system states and references are available. LISC is designed in this artificial environment. After 
the design, LISC can be used in real working environments with limited information, where 
FISC is not applicable. 
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Design Procedure 


Controller Design 
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: Usage of the Controllers 
1 | Usage only with Usage also with 
I 
I 


Full Information Limited Information 


Figure 3.2: The design idea of LISC using FISC 


The core notion of LISC is that the CS models the mutual efforts of the human and the automation 
to their own goals. If this mutual effort is zero, neither the interacting human nor the automation 
strives to change their inputs. The CS is defined as follows. 


Definition 3.7 (Cooperation State) 


Let a LISC according to Definition (3.5) be given. In that case, the mutual efforts of human 
and automation can be described with an artificial system state vector 


Lrt) = E (ul (t), u®(t)), (3.28) 


which characterizes the interaction between human and automation. This system state is 
called cooperation state £. 


Note 1: 
Since (3.28) encapsulates the inputs of the human, it has an indication of the non-measurable 
system part. 


Note 2: 

The function € should characterize the result of the shared effort between automation and 
human. Definition 3.7 does not include any restrictions on the structure of CS and does not 
provide calculation procedures. Due to the fact that the notion of CS is application specific, its 
structure depends on the characteristics of the differential game. 


In order to make Definition 3.7 suitable for the design of LISC, restrictions on the structure 
of CS need to be specified. For this specification, the human’s control law is assumed to be a 
linear feedback controller’ as supported by literature [Hap92, TJ02, WDZ*20]. Example 3.1 


This is a reasonable assumption to reduce the complexity of the human’s behavior. A linear control law reduces 
the complexity, but still provides a suitable reconstruction of the human behavior on the action level of their 
motions, which is shown in literature. Human models on the decision level (e. g. [FAI* 19, RWIH20]) require more 
complex characterization. However, such models on the decision level are not the focus of this thesis. 


38 3 Limited Information Shared Control 


illustrates that the concept of CS can be applied to an arbitrary non-linear system with linear 
control law ofthe human and the automation. 


Example 3.1: 
Let the following nonlinear system with two states be given 
m(t) = -2-t-am(t) + u(t) (3.29a) 
Enm(t) = -t £2 (t) +2- Lum(t) £m(t) + Pam (t) +u™, (3.29b) 


which is a non-linear, time-dependent input-affine system. It is assumed that x(t) is mea- 
surable for the automation, while &um(t) is not. The feedback control laws of the human and 
automation are assumed to be linear 


u(t) = -K™ a(t), (3.30a) 
u™ (t) = -K™ x(t), (3.30b) 


where x(t) = [2m(t), £um(t)] and the feedback gains are 
K® =[0.5, 0] and K® = [0.75, 2.5], (3.31) 


which stabilize the system. Note, these feedback gains can be assumed to be the result of FISC 
design, which entails the cost functions of the human and the automation, see Section 3.1.2. For 
the sake of brevity and to keep the focus of this example on the proposed CS, the design steps of 
FISC are omitted and the values in (3.31) lead to a stable control loop. 


Assuming that the state &um(t) is non-measurable, the automation cannot take into account 
XCum(t) in its control actions. Therefore, the automation cannot support the human directly. A 
possible solution is the use of the CS, which can provide a substitution for y(t). The structure 
of CS is assumed to be as follows: 
2 
a(t) = E1 u (t) + Ea U(t) -uP (t) + B3- ul dt). (3.32) 
This CS is supported by the structure of (3.29b). Due to the linear control law (3.30), the 
correspondence of £x (t) is formulated as 
2 
a,(t) = E1 u(t) +E U(t) u(t) +83. u(t), 
— — mm — 
= rh (t) = nm(t) 2m (t) = tnm(t) 


where — symbolizes the implication of the corresponding elements. The reasons for these 
implications are the following: 


e x2 (t) is quadratic in (3.29b), therefore, u(t) is included in (3.32). 
e Znm(t)£m(t) is a product term in (3.29b), which is enclosed by the second term of (3.32). 


e Znm(t) is linear in (3.29b), which corresponds to the third term of (3.32). 
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These similarities are used for reconstructing £nm(t). =; are manually tuned using simulations, 
where the initial values of the simulation are chosen to £o = [0.75, -0.25]. The goal of the 
tuning was to minimize the error between x,,(t) and %pm(t). This manual tuning was possible, 
due to the small number of parameters. The obtained parameters are 


=, =-1.45, 32 = 0.25 and 33 = -0.4. 


The results are given in Figure 3.3, which shows that x,, can reproduce the trajectory of £nm- 
This way, after the design procedure, the automation can use x,, in situations, in which tym 
is available. In principle, x,, could also be applied in situations, in which £nm is available 
for the automation. However, in that case, the usage of £nm is not reasonable and there is no 


need for x... 
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Figure 3.3: Example of the cooperation state trajectory 


In Example 3.1, the CS is chosen based on three assumptions: 
1) The feedback gains of human and automation are linear. 
2) The system dynamics are given and used for specifying the structure of CS. 
3) The parameters are manually tuned by an ad-hoc heuristic. 


Due to the simplicity of the example, this manual tuning worked well. Furthermore, the CS is 
used to reconstruct the non-measurable system states, which correspond to the mutual effort 
of the human and the automation in the shared control setup!”. In order to generalize the 
procedure, the following idea is used. 


According to Assumption 3.2.2, the human-controlled system part has no impact on the 
automation-controlled subsystem. Therefore, the control laws of the human and the automation 


19 In the case of large vehicle manipulator from Chapter 1, this mutual effort can be explained intuitively: Both the 


operator and the automation strive to reach the reference of the manipulator as good as possible. 
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are used for such a systematic determination of CS. It can be assumed that the control inputs of 
the automation and the human are determined by a function?” of the current system states 


[wu (t), uw (t)] =K (x(t), (3.33) 


where K is a general feedback control law of the shared control setup including the automation 
and the human. The essential characteristic is that there is a deterministic relation between 
uw) (t), u® (t) and a(t). Applying the generalized inverse of (3.33) leads to 


a(t) =K™ (uP), a (£)), (3.34) 


where the O~ symbolizes the generalized inverse, for more details, it is referred to [EH13] or 
[KR15, Chapter 2]. Note that the function K® is not necessarily bijective meaning that unique 


inverse does not exist in general. Therefore, if (3.34) is not unique, KW can be calculated in 
an approximative way only. 


As it can be seen, (3.28) and (3.34) have similar structures. Moreover, x(t) includes £nm(t), 
thus, a subset of K‘") has to correspond to £. Clearly, both (3.28) and (3.34) provide algebraic, 


approximate mappings, thus the corresponding subset of K‘") can be used to determine the 
structure and parameters of CS, omitting manual tuning. Then, if the function € is obtained 


from K)” and apm is reconstructed by x,, the application of classical control methods is 
possible. The idea of the CS is general and can be applied to systems without non-measurable 
parts. However, primarily, systems with limited information and unidirectionally coupled 
dynamics benefit from LISC, cf. Example 3.1. 


Using Definition 3.7, the measurable system part is extended with the CS such that 
ae(t) = [atm (t) ut) a, (¢)]" «RP. (3.35) 


Note that u® (t) is included in the extended system state and the novel input of the automation 
is chosen to u? (t). This integral extension is necessary to avoid algebraic loops and to enable 
a systematic treatment of LISC”’. The obtained extended system is 


telt) = Fe(t,wo(t)) +9 (a) + a (uO) (3.36a) 
z.(0) = £0, (3.36b) 


which only depends on the system dynamics and the inputs of the human and the automation. 
In (3.36), fe, gS and gs” are the system dynamics and the input functions of the automation 
and the human adapted for the extended system formulation, respectively. This formulation in 
(3.36) enables the use of standard control methods. An apparent solution is designing an optimal 
controller for (3.36), which leads to the following optimal control inputs of the automation 


w(t) =argmin AL (t,are(t), ut) (3.37a) 
ule) 
w.r.t. (3.36), (3.37b) 


20 K is the general feedback control of the human and the automation in shared control setup. It generally not limited 


to linear control laws. The core idea and the corresponding steps would also suit a nonlinear model of the human 
behavior or nonlinear system dynamics. 

Note that dynamic feedback extension is a common procedure in the control engineering literature, see e. g. [Gil69, 
Loh91, AWN12] 


21 
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where * symbolizes the optimal solution. Example 3.1 shows how the automation can still 
have information about the non-measurable state and (3.37) provides an optimization for the 
design of LISC. Thus, the concept can be generally used for various problems, in which one 
ofthe subsystems has limited information on a part ofthe system. Such examples could be 
e. g. adaptive cruise control systems [PSv*11, Sd13] or distributed control systems [LL15]. 


However, choosing an appropriate structure may be difficult, and an unsuitable choice can 
lead to a useless CS. To overcome this challenge and reduce the computation complexity, the 
following subsection presents the LQ formulation and the design steps of LISC. 


3.2.3 LQ Limited Information Shared Control 


This subsection presents the application of LISC for linear systems. It is assumed that the 
system matrix A and the input matrices B™, i € {a, h} are known. The cost functions of the 
human and the automation are quadratic cf. (3.14). Formulating (3.27) with linear dynamics 


yields 
3 (a) 0 
=], ee Hia oofa ero (3.38a) 
y(t) = Em (3.38b) 


with the assumption that £nm has no impact on &m cf. Assumption 3.2.2. For such linear 
systems, CS is defined as follows. 


Definition 3.8 (Cooperation State for Linear Systems, [VIH22]) 


The cooperation state for linear systems is defined as the linear combination of the 
inputs of the automation and the human such that 


z,(t) = Bu (t) + EPU (t) eR, (3.39) 


where the matrices B® e R"*P« and E®™ eRF*Pr are design parameters. 


Note: 

Using Definition 3.8 always leads to a CS, which enables the reconstruction of the non- 
measurable system parts of (3.38a) with a linear control feedback of the human. Due to 
the linearities of the system dynamics and the linear feedback, the CS needs to be chosen as 
linear combination of the inputs of the human and the automation. 


A further benefit of Definition 3.8 is that the CS has the same dimension as the non-measurable 
states Zum € R“ of the original system. Furthermore, the specification of x, is reduced to the 
identification of the parameters of =.) and 5, With (3.39), the following extended system 
dynamics are obtained 


tm(t)] [An BY olf am(t) 0 0 
Dm=- 0 o ofu] 1 WH] 0 Ju 2), (3.40) 


&.(t) o 0 Off a(t) | |E® z) 
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where the derivative of the original system input i is taken into account for the design 
procedure of LISC only. The structure of the extended system matrix implies that x,, has an 
effect on £m and wu, if a feedback controller is designed such that 


úf olt) = Kilo zelt). (3.41) 


To compute the feedback law, an LOR problem is formulated, excluding the non-measurable 
states £nm from the design. For the LOR design, the model (3.40) and the cost function 


Kos [welt Rozett) + HOT )R Rta (0 at (3.42) 


are used. The optimum is computed by the dynamic optimization 


i) (t) =arg min IN a(t, telt), U (t), u™ (2), (3.43a) 
ùu) 
w.r.t. (3.40), (3.43b) 


which leads to the feedback gains Ki in (3.41). The computation of (3.43) happens with 
classical LQ optimization, see e. g. [PLB15]. To obtain the original system input, the integral 


uko (t) = ie oe (T*) (3.44) 


is computed. In (3.40) the initial value of original system input u® is assumed u(®(0) = 0 
meaning that the original system input signal is zero at the beginning. This is a plausible 
assumption, since the controller can be initialized to zero without loss of generality. 


3.3 Overview of the LISC Design Procedure 


After the presentation of LISC, two important questions remained open: 
1 How to determine the matrices =) and 3® of CS in (3.39) and 


2 how to choose Qe, and RG) o in (3.42) or the feedback gains Ka in (3.41), in order 
to fulfill the predefined high-level requirements given mathematically by J‘. 


To answer these two open questions, in [VSB* 20], a practical procedure is proposed: The 
parameters were directly configured by the test subjects. They had the possibility to tune two 
controller parameters with practical meaning: One was the "gain of the support" and the other 
was the "speed or quickness of the support". They tuned these parameters until the preferred 
behavior was reached. Although this seems a practically promising strategy, this heuristic 
controller design still impedes the general application of LISC, see heuristic controller design 
in Figure 3.4. 


Therefore, to enable the general transferability of LISC, a systematic framework is essential. 
The design scheme is visualized in Figure 3.4. This systematic solution was proposed in 
two research publications [VIH21, VIH22]. The core notion is the following: The starting 
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Figure 3.4: The constructive design procedure of LISC is shown using four steps with the corresponding sections 
is shown: 1) FISC design, 2) the class of potential games, 3) the idea of the cooperation state and 4) an 
optimization to compute the feedback gains of the LISC. 


point of a designed FISC including all information of the shared control setup. Then a more 
compact, substituting representation of the differential game model is sought, which enables 
the constructive calculation of the parameters of the CS. Finally, the feedback gains of the 
controller are computed such that it fulfills the high-level requirements. 


The subsequent elaborations provide this systematic design which consists of the following 
steps: 


1 In the first step, a FISC is designed based on methods from the state of the art, see 
Section 3.1. FISC is assumed be the ideal solution of a shared control problem, since, an 
optimal control law can be obtained from FISC, which fulfills the high-level requirements 
and allows the human to act optimally regarding their own cost function. 


2 In the second step, a substituting representation of the differential game with N players 
without the loss of essential properties is sought. This thesis shows that differential 
games can be modeled as potential games in a more general way if the existing subclasses 
of potential games are extended. The core notion is that the compact presentation of 
FISC, using potential games, facilitates the computation of the parameters of LISC. The 
novel subclasses of potential differential games are presented in Sections 4.2 and 4.3. 


3 In the third step, the parameters of the CS are calculated by means of the identified 
potential game. This procedure involves the reformulation of the optimality conditions of 
the identified potential game leading to a constructive design of the CS. The computation 
steps are given in Section 4.5. 


4 In the fourth step, the feedback gains of LISC are computed, for which two possible 
solutions are presented in Section 4.6. 
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3.4 Summary of the Chapter 


This chapter introduces the concept of LISC and answers the first research question from 
Chapter 2 by introducing a novel representation of the shared control setup. The first section of 
this chapter presents the preliminaries on game theory and a systematic, model-based shared 
control design of [FOSH14a], which is referred to as FISC, because all the system states need to 
be available for the automation. However, this assumption does not always hold for practical 
applications. Therefore, the main contribution of this chapter is the proposition of LISC, which 
can overcome the problem of the limited information of the automation in shared control 
setups. The concept of LISC is formalized which enables a broad usage of the concept. Then, 
the proposed LISC is analyzed for linear-quadratic games in detail, for which a mathematical 
definition of the CS is elaborated. The CS can model the mutual effort of human and automation 
in shared control setups. Finally, a systematic controller design is proposed with four design 
steps. The overview of this design procedure is followed by the in-depth of the design steps in 
the next chapter. 


4 Systematic Design of LISC: A Potential 
Game Approach 


After the presentation of the general concept of LISC, the steps of the proposed systematic 
design procedure is presented in detail for the LQ case in this chapter, for answering the second 
research question. The first step formulates a FISC based on the procedure discussed in Section 
3.1.3. In the second design step of the design, the differential game is modeled by means of 
a potential game. Therefore, the chapter begins with the preliminaries on potential games. 
These preliminaries are followed by the discussion of shortcomings and limitations of the 
existing classes of potential games and the necessity of an extension to enable their broader 
usage is motivated. Thereafter, Section 4.2 and Section 4.3 present two novel subclasses of 
potential games, which are the so-called ordinal potential differential games (OPDG) and near 
potential differential games (NPDG), respectively. The necessary and sufficient conditions for 
the existence of NPDGs and OPDGs are given. Furthermore, algorithms are developed, which 
can determine these novel subclasses of potential differential games. Section 4.5 begins with the 
constructive computation of the CS, which is based on the optimality principle of the control 
problem. Then, two methods are presented to compute the feedback gains of the proposed 
LISC. Finally, the stability analysis of LISC is discussed at the end of this chapter. 


4.1 Preliminaries on Potential Games 


The following subsection presents the fundamentals of potential games, which are necessary 
to highlight the shortcomings of the existing subclasses. Furthermore, the notations essential 
for the presentation of the two novel subclasses in Section 4.2 and 4.3 are introduced. 


4.1.1 General Concept of Potential Games 


The very first idea of a fictitious function replacing the original structure of a non-cooperative 
strategic game with N players was given by Rosenthal [Ros73], in which the class of strategic 
games with (at least) one NE are identified. Based on this idea, the formal definitions of potential 
games were first introduced by Moderer and Shapley [MS96]. 


The general idea of potential games is presented visually in Figure 4.1: The original non- 
cooperative strategic game?” with N players and with their cost functions J, i = 1...N are 


22 Note it is assumed that the original game is given, therefore the term given game is used interchangeably to 


emphasize this property of the original game. 
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replaced with one single potential function. This potential function provides a single mapping 
of strategy space U =U x... x U) of the original game to the real numbers 


JP:U>R, (4.1) 
instead of N mapping of the combined strategy set of the players to the set of real numbers 
JO :U>R,VieP. (4.2) 


In other words, the potential function is a substituting model ofthe original game without losing 
essential information. Intuitively, it is easier to compute the NE of the original non-cooperative 
strategic game using (4.1) than (4.2). An important property of potential games is that they 
possess (at least) one NE. If in addition, the potential function is bounded and strictly concave, 
the NE is unique. These properties make them attractive for the analysis of strategic games 
[GH16], [LCS16, Section 2.2]. 


The optimum of this potential function corresponds the NE of the original game, see Figure 4.1. 
Moreover, the decision dynamics of a potential static game converge”? towards the NE of the 
game. However, it is not easy to find the potential function for a given original game (4.1) in 
certain applications. Potential games are a subclass of strategic games, thus not all strategic 
games can be modeled as potential games [LCS16, Chapter 2]. 


Identification of the Potential Function 


Original Non-cooperative 


Strategic Game Potential Functions 


Solution of the 
Original Game 
using (4.2) 


Optimization of the 
Potential Function 


using (4.1) 
Nash Equilibrium of 


the Original Game 


Figure 4.1: The general idea of potential games is illustrated, in which the original game is replaced by a (fictitious) 
potential function. The optimum of this potential function provides the NE of the original game. 


There are different subclasses of potential static games: exact, weighted, ordinal, generalized 
ordinal, best-response and pseudo potential games. Not all of them are examined in this thesis, 
therefore, for more details on these subclasses, it is referred to [MS96, DHZ06, Voo00, GH16] 
or [LCS16, Chapter 2]. 


The class of potential games is getting more attention in the research community. They are 
applied in recent years in various engineering applications e.g. cooperative drone control 


23 Note that the terms dynamics and convergence do not relate to the dynamics in the context of differential games. 


In case of static games, they mean the dynamics and convergence of the decision-making process, which leads to 
the NE of the game. 
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[NTM*20, KYM21], mixed traffic intersection scenarios [FG20, LTF*22], power network man- 
agement [ZMZ*21], vehicle routing control [BYM22] or for cooperative learning methods 
[Tat18, SMK20]. 


4.1.2 Exact Potential Static Games 


Exact potential static games are the most restrictive subclass of potential games. They are 
non-cooperative games that admit having a potential function and fulfill Definition 4.1. The 
optimum of the potential function provides the NE of the original non-cooperative game. 


Definition 4.1 (Exact Potential Static Game) 


The strategic static game Pes according to Definition 3.1 is an exact potential static 
game, if and only if there is a cost function J‘) such that 


JO (uw?) -JO (uu?) 
= JP) (aa) _ yl) (us? at?) VieP (4.3) 


holds, where J© are the cost functions of the players of the original game. The two 
different input strategies of player i are ul) and uf), The vector ul) denotes the fixed 
inputs of all the other players. 


Lemma 4.1 (Monderer and Shapley) 


Let a strategic game [es be given. Furthermore, let an exact potential function J‘) 
according to Definition 4.1 be given. The equilibrium set J of the strategic game Tes (J) 
corresponds with the equilibrium set of Tes (7), where JP) ={J®), ..., JPY de- 
notes the strategy set of the potential functions. 


The strategy set (ui : ud) c) is en equilibrium of Tes if and only if 


J (uO? a9") > JP (uw) 


holds. Consequently, the optimum of JP) corresponds to the NE of T os. 


Proof: 
See the proof of Theorem 2.2 in [LCS16]. 


To illustrate and explain the basic idea of potential games in a simple, comprehensible way, 
the example of the Prisoner’s Dilemma is presented which can be characterized as an exact 
potential static game. 
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Example 4.1: 


In the Prisoner’s Dilemma, two criminals are accused of committing a crime together. They 
will be questioned individually, without any communication. Ifthey both deny the crime, they 
receive short imprisonments (each gets one year of imprisonment). If they both confess, they 
receive a higher penalty, but not the maximum penalty because of their confession (each gets 
three years of imprisonment). If only one of the two prisoners confesses, he will go unpunished 
as a witness and the other will receive the maximum penalty as a convicted but unconfessed 
offender (the witness gets no imprisonment, the offender gets four years of imprisonment). 


This problem can be formulated as a non-cooperative strategic game T, which has 
e two players P = {1,2}, 
© two identical strategy sets U‘) =U) = {uy, ua}, 


e a combined strategy set 


u xU = a ut), (ug? at”), (u u), (u a 


+ the cost functions of the players 


JO :U —> {1, 0, 4, 3} (4.5) 
J) :U > {1, 4, 0, 3} (4.6) 


The game can also be formulated in the matrix form, which provides the payoffs as a matrix 
for the combinations of the strategies. 


Player 1 denies Player 1 confesses 
1 1 
(a (2) 
Player 2 denies (uP) (1 
Player 2 confesses (u) (0 


As this strategic game is non-cooperative, it ends in an equilibrium, which is the NE of the 
game. From the viewpoint of player 1, it is rational to choose the confession (us?) because 
he gets a lower punishment independently of the choice of player 2: no imprisonment instead 
of one year (uP) or three years instead of four years uP ). Due to the game’s symmetry, 
player 2 has the same decision process. This means that in this non-cooperative game situation, 
both players choose to confess leading to the equilibrium point (us? ‘ 2), which is the NE of 
the game. 


It can be seen that finding the NE even in this simple game is not straightforward. Using the 
idea of the potential games, a fictitious function can be introduced, which is a substituting 
model ofthe original game including its all characteristics. A possible potential function for the 
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Prisoner’s Dilemma can be defined such that the cost functions of the players J“) and J?) 
are replaced by 


JP:uU>12,1,1,0%. (4.7) 


This potential function in matrix form is given 


Player 1 denies Player 1 confesses 
uf?) (us?) 
Player 2 denies (u) 2 1 
Player 2 confesses (u ) 1 0 


Clearly, this is an exact potential static game since 


ID (uu?) - IO (uu?) = J(u) ul) - IP (uu?) =-1 (48a) 
and 


ID (uu?) - IDO (uP u) = IP (u, ul?) - JO (u u) =-1 (48b) 


hold for both players. Note the potential function J(P) is not unique, there are infinitely many 
potential functions, which fulfill (4.8), e. g. J) = J®) +R. With the help of J(P), the NE can 
be determined more easily using this potential structure. Indeed, minimum of J(P) corresponds 
to the NE of the original game. 


An obvious extension to potential static games is the inclusion of underlying system dynamics. 
Dynamic games can describe numerous practical engineering applications, see e. g. [FFH17, 
ESP21b, NC22]. In literature, systems without time dependencies and with potential structure 
are also addressed, see e. g. [Mar12]. However, the application of this thesis takes such sys- 
tems into consideration that possess time dependencies of the underlying system dynamics. 
Therefore, exact potential differential games are addressed in the next subsection. 


4.1.3 Exact Potential Differential Game 


The concept of potential games is extended to differential games (cf. Definition 3.3), [DLLP09]. 
In [GH16, FH18], overviews of exact potential differential games are given. An exact potential 
differential game differs from the static case in such a way that the underlying system dynamics 
has to be taken into account and through the potential function, an optimal control problem 
is obtained. In the following and throughout this thesis, the LQ case is discussed. An exact 
potential differential game is defined as follows [FH18]. 
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Definition 4.2 (LQ Exact Potential Differential Games) 
Let an LO differential game Teq with system dynamics 
i(t) = Aa(t)+ > BOu (t), (4.9) 
ieP 


be given as defined in (3.12). Furthermore, let the quadratic cost functions (3.14) and 
Hamiltonian functions (3.15) ofthe players be given. Assume that the aggregated inputs 
ofthe players and the aggregated input matrices are defined such that 


u?)(t) = uw"), wu)" (2), Tn] (4.10) 


and 


BP) = [B® B®, n B®] 


respectively. Furthermore, consider an LQ optimal control problem over infinite time 
horizon Tend > œ with the cost function 


1 Ten 
J® = 5 ie “eT (QM a(t) +u "(QR u® (tat (4.11) 
0 
as well as the Hamilton function 
1 1 
H)(t) = sett) QM a(t) + Zu RU (N) + APT F(t), (4.12) 


where the matrices Q(P) and RP) are positive semi-definite and positive definite, respec- 
tively. If 
dH) (t) OHM (t) 
du (t) u(t) 
holds for Vie P, the LQ differential game Ig. is an LQ exact potential differential 
game, which has the potential function JP). 


(4.13) 


The necessary and sufficient condition of exact potential differential games is presented in the 
following for the general case. 


Lemma 4.2 (Fonseca-Morales and Hernandez-Lerma [FH18]) 


Let a differential game Toq according to Definition 3.3 be given. Let h® be given cf. (3.4) 
and defined such that the instantaneous cost of player i 


hÒ (t, æ, u) = 27 QMan+ uP) ROY), 
and Teng > œ holds. Assume that 


x = [xı, £2, ..., Zn]! and u = (ut, uf, Jen u®], VieP. 
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Furthermore, assume that one of the following conditions (i)-(iii) holds Vi € P: 
+ (i) The instantaneous cost of player i fulfills 


Arn) anh — An an 
OLE, u Ox; A: Ork ae Ork 


Vk=1..n. (4.14) 


+ (ii) The instantaneous cost of player i fulfills 


dh An 
xı u Ork 


k=1...n. (4.15) 
and, the system dynamics is decoupled such that 


f = [Fo (21,09) ’ f (22,u)) ate) Fr (x,,u™)]", 


where f® depends only on x; and uw Vie P and 


OF. BF") 
Ox, Ox, : 


k=1..n (4.16) 


iii) The instantaneous cost of player h“) depends on x; only, instead of the fu 
(iii) Th play h® dep d ly d h ll 
state vector x l O 
pO (t, x, ul?) = AO (t, xi, u”) 
and 
afo af™ 
0x1 u Ork : 


k=l..n (4.17) 


hold. 


If, in addition to Assumptions (i), (ii) or (iii), there is a function J) = ia: hP) (t, x, ul?)) dt 

such that “es i 
ðh Oh? 
Hu = du lE P (4.18) 


and 
Bh® Ək 
Ox; = Ox; i 


VieP, (4.19) 


then, the game [cq is an exact potential differential game with the potential function J‘). 


Proof: 
See the proof of Lemma 1 in [FH18]. 


As in (4.11), a quadratic potential function J‘?) with a linear underlying system dynamics (4.9) 
is assumed, the linear optimal control law 


uP (t) = -K) x(t) (4.20) 
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is computed which is associated with the NE of the original game. The feedback gain is 
computed by 


K® = RO BOT pe), 
where PCP) is the solution of an algebraic Riccati equation 


O=-A' P® + PMA 4 QP _ PO BO RY Be) pe). (4.21) 


The necessary and sufficient conditions for the existence of a potential function in accordance 
with Definition 4.2 hold for problems with special structure only, see Assumptions (i)-(iii). 
Therefore, the next subsection presents a less restrictive subclass of potential games. 


4.1.4 Ordinal Potential Static Games 


Ordinal potential static games were first introduced for static problems in literature [MS96], and 
their characteristics were studied in further works [VN97, Kuk99]. An extension to differential 
games does not exist in literature. To illustrate the limitations of exact potential static games, 
the following example presents a modified version of the Prisoner’s Dilemma, cf. Example 4.1, 
with asymmetric payoffs. 


Example 4.2: 
Let Example 4.1 have a modified payoffs’ matrix such that 


Player 1 denies Player 1 confesses 
(u?) (us?) 
Player 2 denies (u) 11 7,0 
Player 2 confesses (u?) 0,6 2,3 


The NE this game is also (u ; u), which is the NE of the game. However, for the Prisoner’s 


Dilemma example a potential function is: 


Player 1 denies Player 1 confesses 
yD yD 
1 2 


P2 denies u” 2 1 
P2 confesses u 1 0 
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whose minimum corresponds with the NE of the original game. However, Definition 4.1 does 
not hold meaning that the game is not an exact potential static game. Still, the following holds 


IJO (UP uP) - IN (uf ) ul?) >0 <= 

TO (uM, u) - JO (uf u) >0 (4.22a) 
and 

JIO (UP ju) - J® (uf u) >0 <= 

TP (UP uw) -JO (u ul?) > 0 (4.22b) 


which enables the computation ofthe NE by minimizing the same potential function as intro- 
duced before. Hence, even in the given situation, where the strict condition on exact potential 
static games is not satisfied, the original game can still be replaced by a potential function. 


Using the idea of Example 4.2, the exactness of Definition 4.1 is omitted and a less restrictive 
subclass, ordinal potential static games, is defined, which was first introduced in [MS96]. 


Definition 4.3 (Ordinal Potential Static Game [MS96]) 


The strategic static game Ios according to Definition 3.1 is an ordinal potential static 
game, if a potential function J‘) exists such that 


(I (uf? uf?) -J® (u$ uf?) ) = 


[7 (a? uy?) — J) (2% a) ) VieP (4.23) 


holds, where J® are the cost functions of the players i € P of the original game. 


For games with continuous strategy sets (if JO is continuous in u), the definition can 


be reformulated to 
G) (p) 
sgn | a ) = sgn | i ) ‚vie®P. (4.24) 


du du 


Note: 

Definition 4.3 is formulated for scalar inputs only. In literature, ordinal potential static games 
were only formulated for problems with scalar inputs. For more details and examples see 
[NP01, DHQS08, HS19, Ewe20] 


The formal condition and its proof for the existence of an ordinal potential static game is given 
by Lemma 2.1 in [MS96]. 
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4.1.5 Discussion on State-of-the-Art Potential Games 


As presented in Section 4.1.1, potential games have appealing properties: A potential game is a 
more compact representation of a given original game that has (at least) one NE. In addition, 
this NE is unique for a convex and bounded potential function. These properties make the use 
of potential static games attractive [LCS16, Chapter 2]. However, in the case of differential 
games, the use of exact differential potential games is limited to systems with special structure, 
see specifications by Assumptions (i)-(iii) in Lemma 4.2, which are necessary to fulfill the 
equality condition (4.13). Consequently, exact potential differential games can only model 
games with special system structure or utility functions of the players defined by Assumptions 
(i)-(üi) in Lemma 4.2. This fact is substantiated by the state-of-the-art examples: For instance, 
restrictions on the relationship of the system states and the inputs of the players are assumed in 
Definition 8 and Proposition 9 in [DLLP09]. A further illustration is the Example 4 in [GH16], 
which shows that exact potential differential games can solve only such problems, in which the 
cost functions of the players are identical or have a special structure. An example of such a 
special structure can be found in [FH18], where it is shown that if the players have quadratic 
cost functions (3.14) with the penalty matrices 


i a Qi i Ti 0 ; 
a-f, = i| ana RO - 1% een 


then the game is an exact potential differential game, since 
e' QU a =a2' Qa 


hold, meaning that Assumption (i) in Lemma 4.2 is fulfilled. Furthermore, it is assumed that the 
number of inputs is equal with the number of state variables in the problems from literature. 
On the other hand, Example 4.2 in [DLLP09] also illustrates that not all games can be modeled 
by means of the exact potential differential games. Thus, condition (4.13) hinders the general 
use of exact potential differential games illustrated by the examples from literature. Therefore, 
novel subclasses are necessary to enable a broader application. 


The core notion is that the subclass of ordinal potential static games is less restrictive compared 
to exact potential static games, thus an extension of ordinal potential static games to differential 
games could probably model more practical applications. However, current literature does not 
include such an extension of ordinal potential static games to differential frames. To this end, 
the subclass of OPDGs for LQ problems is introduced in the next section. 
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4.2 Ordinal Potential Differential Games 


This section introduces the novel subclass of OPDGs. First, the formal definition of an OPDG 
is given, which is followed by the necessary and sufficient conditions for the existence of an 
OPDG. In the second part of the section, the computation of a potential game for the original 
game is presented: For a given differential game the ordinal potential function is identified. 


4.2.1 Definition of OPDG 


For the subsequent analysis of OPDGs, the following is assumed: 


Assumption 4.3.1 The game is restricted to two players with scalar inputs and the weighting 
in their cost functions (3.14) are 


Q = diag[g® a, ..., aD] and 
R” = diag[r{?,r$?], P = {1,2}. 


Assumption 4.3.2 A quadratic potential function is assumed, cf. (4.12), in which the weighting 
matrices are symmetric 


Definition 4.4 (LQ Ordinal Potential Differential Games) 
Let an LQ differential game (4a with system dynamics (4.9) be given. Furthermore, let 


the quadratic cost functions (3.14) and Hamilton functions (3.15) of the players be given. 
Let Assumptions 4.3.1-2 be held. Let J“) according to (4.11) and HP) according to the 
Hamiltonian (4.12) be given. If 


— (dH (t)\ (IHO) 
sn Foy) (Fas ks 


holds for Vie P, the LQ differential game Toq is defined as an LQ ordinal potential 
differential game, which has the ordinal potential function JP). 


Note: 


(») G) 
Under the Assumptions 4.3.1-2, (og) and (Fr) are scalars. 
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4.2.2 Necessary and Sufficient Existence Condition of OPDG 


Lemma 4.3 (Necessary and Sufficient Condition of an OPDG) 


Let an LQ differential game 14a described by Definition 3.3 be given. Furthermore, the 
Assumptions 4.3.1-2 hold. 
If there is a game (oq, for which 


(BOTP® x(t) (BOTP™ x(t) >0 (4.26) 


holds for Vie P and Va(t), then Toq is an LQ OPDG and can be represented through 
potential function described by Definition 4.4. 


Proof: 
For the proof, Definition 4.4 is used: 
dH) (t) dH (t)\ . 
sa( OA) = sgn OA VieP. (4.27) 
Assuming a quadratic potential function and linear system dynamics, cf. Definition 4.2, 
OH) (t) 
re NS RY) (p) t) + BOT ©) t 4.28 


holds, where A‘) (t) = P) x(t) can be applied, which is obtained from the solution of (4.21). 
The control law of the potential game is obtained from the solution of (4.21) but a small 
perturbation of the optimal solution is applied in the following. The reason for that is the 
following: An optimal control law means that 


3HP (t) 


DuA 


which is not suitable for the analysis of the existence of a potential game as in that case (4.27) 
yields 0 = 0. The perturbation of the optimal control law of the potential game is 


u(t) = -(1 +P (x)) RP BO PO z(t), (4.29) 


in which 0 < e” (x) < 1is an arbitrary small scalar variation function. With e.(x) > 0, the 
optimal control law is obtained. Substituting (4.29) in (4.28) gives 
OH?) (t) 


ee NILE -R®)(1 4 EPL) RO BOTPO) g(t) + BPTP x(t), (4.30) 
Ou?) (t) 


which can be simplified with RP) and due to (4.10) rewritten as 


HOE) __.0) (4) ROT PO) 
u(t) =e (z)B P x(t), VieP. (4.31) 
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For the players of the original game, the derivatives of the Hamiltonians are expressed as 


IHO (t) 


= ROU (t) + BOT AO (t 4.32 


hold. Furthermore, AË (t) = P x(t) can be substituted into (4.57). Analogously to the 
potential function calculation, a small perturbation of the control law is applied for each player 
of the original game. These inputs are computed by 


u(t) =-(14 (2) ROBO PO x(t), (4.33) 


where 
0< (x) <1, Yie P 


are arbitrary small scalar variation functions. The control law (4.33) yields the behavior of 
players around the optimal solution. Substituting (4.33) in (4.57) gives 


i) T 


(3) , , n i STO 
oH = -RO (1+ O (ROBO POr) +BO'POE(), (434) 


du (t) 
which can be simplified to 


dH (t) 


2 TDG) 
O es’ (z)B“” PY’ a(t). (4.35) 


Substituting (4.31) and (4.35) in (4.27) yields 
sgn (BP) = sgn (<(?(2)BO"POx(s)) , VieP, (4.36) 
which can be rewritten to 
sgn (eP (a)) sen (BOP EA) = sgn (e(az)) sgn (BO"POx(s)) , Wie P. (4.37) 
As both 


sen (eP) (æ)) > 0, 
sen (e(x)) >0, Yi eP 


hold, 
sen (BOP 2(1)) =- sen (BO"POn(s)) ‚Viep (4.38) 


is obtained. 
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Since, both terms (BO'P2(1)) and (BO PO) are scalars, the equality of two sign 


functions can be reformed to a multiplication such that 
(BO POs) ; (BOTPO«() >0, VieP, (4.39) 
which proves the lemma. o 


Remark: 

The limitation of Lemma 4.3 is that it provides a non-constructive condition for the existence 
of OPDGs. However, this condition is still beneficial for the LISC design since a substituting 
model of a differential game is found. In the case of LQ differential games, the challenge is not 
computing of the NE” but finding a replacement of the given original game, which still implies 
all its necessary details. Consequently, Lemma 4.3 proves that the obtained OPDG can be used 
as a substituting model for the constructive LISC design without loss of crucial information. 


4.2.3 Two Methods for Computing an OPDG 


In the previous subsection, the question, under what conditions an OPDG exists, is answered. 
This subsection provides computation methods, which yield the potential function for a given 
differential game using the conditions derived in Section 4.2.2. In the LQ case, finding the 
potential function for a given differential game can be simplified to determine the parameters 
QCP) and R®) of the potential function J‘). 


Computation by means of the Input Trajectories 


The first method uses the deviation of the input trajectories u(P) of an ordinal potential 
differential game from the NE of the given original differential game. The deviation is defined 
as 


e,,(t) = uP (t, x(t), QP, RO) - u*(t,x(t)) (4.40) 


where u* = [u® a u) | is the concatenated optimal inputs of the players in the NE of the 
original differential games. It is assumed that Q), R , u Vi € P are given. The goal is to 
find the quadratic potential function J) as given in (4.11). With help of the known system 
dynamics (4.9), uP) is obtained from the solution of the Riccati equation (4.21). Then, the 
deviation (4.40) is minimized. Such an optimization can be solved with a sequential quadratic 
programming (SQP) optimization algorithm [NW00, Chapter 14, 18], which stops, when the 
error is smaller than a predefined optimization threshold €optim. The parameters of the potential 
function are accumulated in the parameter vector 


A) = [vech(QP), vech(R)], 


24 In literature, one of the reasons of potential static games is that the computation of the static NE can be complex. 
Thus, the use of potential games can reduce the complexity of such static games. 
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where vech is the half-vectorization of a matrix, which is defined such as 


1xin(n+1 
vech(A) = [au, Q21; °° An1, 422, 432, °° An2, °° An-1,n-1) An,n-1; an,n] e R”? ( ), 


The optimization of (4.40) starts with the initial value o? ) and is carried out by the following 
optimization problem: 


AO RO PO- argmin Fl Ti eult)? dt (4.41a) 

QP ROP), pe) JO 
st. ATP®) +P A + QP = POBO RO Be pe) =0, (4.41b) 
(BO PO zt) i (BO POz()) >0, Vie P. (4.410) 


The minimization of (4.41a) ensures that u(P) = [u® ; u] holds”. Constraint (4.41b) ensures 
the minimization of the potential function J) meaning that u”) is provided by the LQ 
optimization of (4.11). Constraint (4.41c) guarantees the necessary and sufficient condition of an 
OPDG. The procedure of algorithm to compute the potential function is given in Algorithm 1. 


Algorithm 1 Input-Trajectory-Dependent Computation of an OPDG 
Input: om, A, BO QO, RO wOviePR 
Output: QP RO 
0m i oP 
while e, < €optim do 
compute PCP) from (4.41b) and oP 
verify (4.41c) 
up) = _RO) Be) pO» 


i=i+1 
update oP with SQP 
end while 


One drawback of this method is that it depends on the trajectories æ of the game, which makes 
the algorithm slow for games with a longer time horizon. Therefore, an alternative approach 
is presented in [VHH23], in which the potential function is directly computed from the cost 
functions of the original game. 


Trajectory-free Optimization 


The computation method presented in this section is referred to as trajectory-free optimization. 
The trajectory-free optimization identifies an LQ OPDG by solving the problem constructed 


°5 Note that interestingly, f Jeu (t)|? dt itself can also be interpreted as a potential function, thus, its minimum 


yields the NE of the original game. 
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as a linear matrix inequality (LMI) problem based on the idea from [PCC*15]. According to 
Lemma 4.3, 


(BOPO z(t) , (BOP x(1)) >0, VieP, (4.42) 


must hold for an OPDG. To calculate (4.42), the trajectories x of the game are required, and the 
proposed optimization is not trajectory-free. Therefore, the simplification of this trajectory 
dependency is discussed, enabling a faster determination of the potential function. First, the 
following notation is introduced: 


vP) = BOPO) and v® := BO" PO, VieP. 
Thus, (4.42) can be rewritten as 
(vP x(t) . (v x(t) 20, VieP. (4.43) 


In order to drop æ, (4.43) must hold Va which means vP) and v™ should point to the same 
direction or v(P) and v(® have to be parallel to x, such that (4.43) holds. This way, both terms 
in (4.43) have the same sign regardless of the actual x, which leads to the new condition 


wy) —y = 9, (4.44) 


where w() > 0 is a scaling factor, see a three-dimensional example in Figure 4.2, where the 
scaling factor is a single scalar. Whether w“‘) is a matrix or a scalar depends on the ratio of 
dimensions of the system states and inputs. Figure 4.2 represents the system state vector x in 
two different time instances tı and ta. Since, vP) and vy point to the same direction, condition 
(4.44) is fulfilled for all time instances. Intuitively, if & has a lower dimension than vP) and 
vÜ) have, there are more possible combinations of v(P) and v®, which fulfill condition (4.44). 
For instance, if x is scalar and coincides with et, then any arbitrary vectors of vP) and vy in 
the plane e? - e? fulfill condition (4.44). 


Using (4.44), a trajectory-free computation of an OPDG can be constructed. Let it be assumed 
that a stabilizing feedback control K (P) and the system dynamics (4.9) are given or can be 
identified from measurements. It is well-known that inverse optimal control problems are 
ill-posed (e.g. scaling ambiguity) [PCC* 15, ER19, MIF*20, ICH21]. Therefore, the minimization 
of the condition number of a concatenated matrix consisting of the searched parameters 


QP) 0 
E(n+p1+p2) S 0 RP) < BE (n+pi+p2) (4.45) 


is proposed, where E(n+p1+p2) is an identity matrix with size of (n + pl + p2) x (n + p1 + p2). 
Furthermore, an additional lower bound is used to omit the trivial solution. The further 
extension to other inverse optimal control problems ([PCC* 15, ER19, MIF* 20, ICH21]) is that 
(4.43) must additionally hold. Thus, the optimization variables are QP RO PO) 8, w 
and the inputs of the optimization (output) are A, BO QO, RO, vie P,K®), which are 
assumed to be given. It is assumed that KCP) is either computed such as 


K”) =[KY K] (4.46) 


or estimated from measurements directly. 
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Figure 4.2: A schematic representation of the trajectory independence of the optimization in a three-dimensional 
space (et, e?, e?): vP) and v™ show in the same direction are linearly dependent, therefore (4.43) is 


fulfilled at tı as well as at any other time t2 


Finally, the following optimization problem results” 


Q® RP, PO Bg Z argmin fe (4.47a) 
Ql) RO) PO) Bw 

st. ATP®) +PMA-POBOK) +Q@ =0 (4.47b) 

BO'P- ROK) -0 (4.470) 

wÖBO'PO -BOPP =0, VieP (4.47d) 
(p) 0 

E< E 22) < BE (4.47e) 

PP >20. (4.47f) 


The constraints (4.47b), (4.47c) and (4.47f) are necessary to guarantee that K (P) ig optimal with 
respect to the identified quadratic potential function. Constraint (4.47e) ensures the uniqueness 
of the solution to constraint (4.47d) restricts the identified parameters ÂP), RO) to the set of 
parameters constituting the potential function of the OPDG. 


If there is a solution of the optimization (4.47), then the optimization is called feasible. However, 
(4.47) cannot always provide a solution. In this case, the optimization is called infeasible. Such 
a feasibility analysis of the LMI is addressed in [PCC*15]. However, (4.47) is more restrictive 
due to constraint (4.47d) compared to the analysis presented in [PCC*15]. Therefore, in the 
following analysis, the necessary condition of a feasible solution is proposed, which shows, 
how the additional constraint (4.47d) reduces the feasibility of optimization (4.47). 


The trajectory-free optimization (4.47) can only provide feasible solutions if the conditions of 
Lemma 4.4 are satisfied. 


26 Note that for the sake of readability, the dimension specifications of the unity matrix (n + pl + p2) are omitted. 
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Lemma 4.4 (Necessary Condition for the feasibility of the trajectory-free 
computation of OPDGs) 


The trajectory-free optimization (4.47) for two players can be feasible only, if 
A) the columns of the input matrix B®), Vi € P are linearly independent and 


B) the system dimensions satisfy 


5(1+n) ~ (pi +p2) >0, (4.48) 


where pı and pa are the dimension of the inputs vectors B®) € R™?!, BO) e R"*P2 
of player 1 and 2, respectively. 


Proof: 
To prove the conditions, constraint (4.47d) is rewritten as 


wÈ -BOPO =0, Vie P, 


which can be vectorized such that 


Ae es ST 
vec (wy) — vec (Bo po) =0,VieP, (4.49) 
and rearranged to 
(E, ® BO") vec (PP) = vec (Wy), VieP, (4.50) 
HM i re ae erh 
Ä 7 b 


where vec(-) represents the column vectorization of a matrix and ® is the Kronecker product 
of two matrices. In (4.50), the classical form of a linear system of equations Ax = b is given in 
the underbraces. 


Condition A is necessary for the consistence of the solution, for which 
XT ST: ; : 
rank (Bn @ BY = rank (E, g BY | vee (2 v)) ‚VieP 


must hold, since an inconsistent solution of (4.47d) leads to an infeasible LMI. 


Condition B is necessary for the following reasons. If (4.50) provides a unique solution, for 
a given vec (wy), then vec(P™)) is completely specified by (4.50). Thus, P(P) cannot 
be modified to fulfill (4.47b) and (4.47c) and consequently, (4.47) cannot not be feasible. On 
the other hand, if (4.50) has multiple solutions, the constraints of optimization (4.47) have 
additional degrees of freedom. This requires a rank analysis (see [BR14, Chapter 5]). Due to 
the fact that the columns of the input matrix BC, Vi € P are linearly independent, 


rank (En ® BO") < dim (vec (P®)) ‚VieP 
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must hold?” meaning that the number of rows are smaller than the number of columns, 
cf. [War05, BR14]. For two players, cf. Assumptions 4.3.1-2, in (4.50) 


T 


(yt 
POD (4.51) 


E9 Be)" 


holds. The size of A is n(pı + p2) x n:n, where pı and pz are the length of the input matrices 
BO and B®. If P(P) was not a symmetric matrix, the condition for a manifold of solutions 
would be n -n > n(pı + p2). Due to the symmetric structure of P(P), the degrees of freedom of 
vec (P®) is reduced to s(1 +n)n, see [BR14, Chapter 14]. Thus, the condition is changed to 


S@+n)> (pı + p2), (4.52) 


which is the proof of the lemma. 


4.2.4 Application of the Computation Methods 


In this section, the methods are applied to an illustrative example and a comparison between 
the input-trajectory-dependent and trajectory-free computation methods is provided. 


Example 4.3: 


Consider an infinite time-horizon LO differential game according to Definition 3.3 with two 
players. The system is given such as 


z(t) = 3 l x(t) + H u(t) + > u(t), (4.53) 


where initial values are chosen to æo = [-1.2, 1]'. The cost functions the players are quadratic 
(3.14), in which the matrices are 
Q™ = diag(3,0), R™ = diag(1,0.5), Q@ = diag(2, 1), R = diag(0.2, 1). 
The feedback gains of the players in the NE are 
K® -[1.418, 0.135]' and K® = [2.233, -0.997]," 


which correspond to the NE of this differential game. The solutions of the coupled Riccati 
equation are 


a) _ [1.408 0.010 (2) _[ 1619 -0.307 
F a Oa 0325 |: 


Note that the assumptions from Lemma 4.2 do not hold for the Hamiltonians of the players 
H“), i = {1,2}. Therefore, this game cannot be modeled as an exact potential differential 
game. 


27 The dimension of a vector is denoted by dim. 
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However, finding a substituting OPDG is possible. First, the input-trajectory-dependent (ITD) 
method is applied, which uses the inputs of the players from the original game to compute the 
inputs of the potential games and obtain the parameters. The initial values of the optimization 
are chosen 


[vech ( P), vech (RP )] = [3,0.5,1,2,0.5,0.5], 


where vech is the half-vectorization of a matrix. The resulting matrices are 


wi _ Be 0.181 


(p) _ |1.480 0.027 
ITD 7 [0.181 ve ond RY, =| 


0.027 1.429 


The necessary time for the calculation was 26.9 s. Algorithm 1 was carried out with the Matlab 
implementation of an SQP optimizer, see [NW00, Chapter 18]. Second, the trajectory-free 
method is applied, which identified the following matrices 


(œ) _ [1.234 0.089 (©) _ [1.061 0.014 
Delia 1.034] ART = [0.014 1.009] 


The computation time of the trajectory-free method was 0.15. The LMI is solved with SeDuMi 
(Self-Dual-Minimization, version 1.3), an open-source software package for Matlab. For more 
details, it is referred to [Stu99]. The resulting trajectories are given in Figure 4.3. It can be 
seen that despite the difference of the identified potential functions, the system trajectories are 
similar. 
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Figure 4.3: Comparison of the trajectories of the given original differential game (ODG) with the trajectories the 
identified potential games is shown. The trajectories ofthe ODG are given in blue, the input-trajectory- 
dependent (ITD) method is in red and the trajectory-free (TF) method is in yellow color. 

Next, the dynamics of the Hamiltonians are compared. The changes of the Hamiltonians are 

given in Figure 4.4. It can be seen that the two computation methods provide similar changes 
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of the Hamiltonians despite the differences of the matrices Q®) and RP). For both methods, 
the zero crossings are at the same time, meaning that condition (4.26) is fulfilled, see t x 1s in 


subplot a). For player 1, the dynamics of the Hamiltonians are not the same, cf. subplot a), for 
player 2, the TF optimization yields a resulting trajectory, which coincides with the trajectory 


of the original differential game, cf. subplot b). 
b) Hamiltonian of player 2 


a) Hamiltonian of player 1 
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Figure 4.4: The changes of the Hamiltonians H), H(2) and H(P) and the comparison of the two computation 
methods - the original differential game (ODG) is compared with the input-trajectory-dependent (ITD) 


and the trajectory-free (TF) computation methods. 


To summarize the application, the benefits of OPDGs are clear: A potential function can be 
obtained even for systems, which do not fulfill the condition of exact potential differential 
games. Thus, OPDGs broaden the possible applications, which can be modeled by means of 


potential games. 
However, the concept of OPDGs provides an extension of the subclass of ordinal potential static 


games under certain assumptions, cf. Assumptions 4.3.1-2. The input trajectory dependent 
computation method can determine the potential function of the original game without any 
restrictions on the system structure. However, due to the optimizer, the method can be slow in 
the case of a longer time horizon or complex systems with a large number of system states. 
Therefore, a computational efficient LMI formulation is proposed, which is restricted to specific 
system structure, cf. Lemma 4.4. If the proposed LMI is not feasible, the optimization (4.41) 
can still provide the potential function due to its generality. Assumptions 4.3.1-2 restrict the 
application of OPDG, thus, the existence of OPDGs is proven for a case with two player and 
scalar inputs only. Therefore, in the next section, the subclass of NPDGs is introduced, which 


provides a less restrictive applicability of differential potential games. 
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4.3 Near Potential Differential Games 


The previous section presented the novel subclass of OPDGs, which uses exact mathematical 
relationships. However, these relationships only hold under specific assumptions, which limit 
the application of the proposed concept. Therefore, this section presents the concept of NPDGs 
and the analysis of their dynamics. NPDGs are less restrictive compared to exact potential 
differential games and OPDGs. Using NPDGs, a more general way to identify the CS of LISC is 
possible. 


The core idea is the usage of a distance metric between two differential games. In that way, the 
required exactness of the exact potential differential games, cf. Definition 4.1 is transformed into 
a less restrictive condition, which permits a small, remaining difference between the two games. 
NPDGs are extended from the static to the dynamic case for the first time in the course of this 
thesis. The concept of near potential static games is introduced in [COP10, COP13]. Based on 
the intuitive idea that if two games are "close" in terms of the properties of the players’ strategy 
sets, their properties in terms of NE should be somehow similar. A systematic framework for 
static games was developed in [COP10]. It was shown that a near potential static game has 
similar convergence of the strategies? compared to an exact potential static game. A similar 
convergence of the strategies means that similar changes in the input strategies lead to similar 
changes in the payoffs in the game. Furthermore, it is also shown that the meaning of "close" 
can be quantified in the developed framework, see [COP10]. In the following, an extension of 
the concept of near potential static games to differential games is proposed. 


4.3.1 Distance between two LQ Differential Games 


Similar to the static case [COP13], a distance measure between two differential games is 
introduced. 


Definition 4.5 (Differential Distance) 


Let an exact potential differential game ro) with the potential function J‘) be given. 
Furthermore, let an arbitrary differential game Tna according to Definition 3.3 be given. 


The differential distance (DD) between ro and Tna is defined as 


‚ieP. (4.54) 


dH®)(t) dH (t) 
ud) du (t) 


28 Note that the convergence of static games means the convergence of the decision-making process, which leads to 


one of the NEs of the game. The term dynamics has no relation to the dynamics of the system states in the context 
of differential games. 
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Note: 

Definition 4.5 defines vector space, in which two games can be compared and their "closeness" 
can be quantified. It is the intuitive extension of Definition 4.2 because for an exact potential 
differential game, 


al? (t) = 0, Yt € [0, Tena] 


holds, meaning that Tnq has the same characteristics as I eq. Softening the condition 0 (t)=0 
enables a broader use. 


Using Definition 4.5, the subclass of NPDGs is formally defined. 


Definition 4.6 (Near Potential Differential Game) 
A differential game Ina is said to be an NPDG if the DD between Inq and an arbitrary 
exact potential differential game ro is 


max Po, <A, ieP, (4.55) 


where A > 0 is a small constant. 


Note 1: 
Definition 4.6 does not exclude the subclass of exact potential differential games as A = 0 is 
possible. Thus, the set of exact potential differential games is a subset of NPDGs. 


Note 2: 

The maximum DD is the measure of the likeness between the games. As the maximum DD 
increases, the dynamics of states and input trajectories of the NPDG are gradually getting 
larger. Thus, the main question is that for a given upper bound A, how large the perturbation 
of the state and inputs dynamics between [yg and re) can be. Therefore, this perturbation is 
quantitatively characterized for LQ games in the following. 


Using the Definition 4.6, the necessary and sufficient condition of the NPDGs is given for the 
LQ case. 


Lemma 4.5 (LQ Near Potential Differential Game) 


Let an LQ exact potential differential game re) with its state trajectories xP) (t) in its NE 
be given. Furthermore, let an arbitrary LQ differential game Tnq according to Definition 
3.3 with its state trajectories x* (t) in the NE of Una be given. If 


Be BOT -BÖ'PO| < A* (4.56) 
ı 2 


holds, then na is an LQ NPDG in accordance with Definition 4.6. 


Proof: 
The derivative of H“ is expressed as 
dH (t) 


— II RO YO (t) 4 BOTAO (t 4.57 
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which holds for i € P. Based on the proof of Lemma 4.3, the derivatives of the Hamiltonian of 
player i can be rewritten as 
dH (t) 
- —_-(@) Tpi) a* 
POIO és’ (£)B P a* (t), (4.58) 


and for the derivatives of the Hamiltonian of the potential function 


OH) (t) N 


_.(p) (i) Dr) „(p) 
du) er’(z)B” PPr” (t) (4.59) 


are obtained, see steps (4.31) and (4.35), where cP) (x) « land e (x) < 1 are scalar pertur- 
bation functions. Substituting the derivatives into (4.54), the DD is stated as 


aof? (t) = 


=) (2) BO PO gP (4) _ O(a)BOTPOr(s)| f 
2 


Introducing an upper bound of the variation £4 := max (el ) (x), ei (@)), the DD is rewritten 
as 


oS) (t) = 


RAT: ‘ . 
BO Pg) (t) - e.BOTPO2*(1)| 
2 


< leel 


[BO POs) 2 BOTPOs*(6)| (4.60) 
2 
It the following, it is assumed that there is a Ax?) (t) < 0 such 
LP (t) = x* (t) + Aw) (t) or (4.61) 


ax!) (t) = x*(t) - Aw) (t) (4.62) 


hold Yt € [0, Tena]. In the on hand, if (4.61) holds, the upper bound of of? (t) is rewritten to 
= leo [BoP (t) -BOTPO gP) (t) + BOTPO As | 
2 


je; (BOR -BOTPO) 2 (0) 


+ Jed [BOPP Az H, 
2 x > 


»0 asec-Ax(P)&1ande.-Axr(P)>0 


DU 


eis |B PP) _ BOTP@ 


i eP A, ie P- (4.63) 


On the other hand, if (4.61) holds, the upper bound of of? (t) is 


a (t) < lled 


BE _BOTp) 


la" sep. (4.64) 


Introducing the notation for the maximum magnitude of the state vectors 


PH) , 


Tmax *= max (||æ* (t) l ’ 


4.3 Near Potential Differential Games 69 


the estimations (4.60) and (4.64) can be combined into 


a(t) < lee] BO pE = BOTPY Lmax 1€ P. 
2 
Introducing A” = eeu leads to the upper bound of o, 
max [Bopo -BO'PO|| <A’ 
i 2 


proving that Tnq is an NPDG with an upper bound of A*. 


If the upper bound of DD og between the NPDG and the exact potential differential games is 
sufficiently small, closed-loop characteristics with similar results can be drawn. In the case of 
differential games system state trajectories are analyzed’. The terms small and similar are 
described more precisely in the next subsection. 


4.3.2 Dynamics of LQ NPDGs 


The dynamics of the system and input trajectories are analyzed in order to provide an estimation 
of the differences between two LQ differential games. Let it be assumed for the LQ differential 
game Tnq that the control laws of the players i € P are obtained from the solution of the 
coupled Riccati equations (3.20) over an infinite time horizon, which leads to the closed-loop 
system dynamics 


&(t) = Ažæ(t), x(to) = £o, (4.65) 
where 
At =A- 3 BOR} BOP 
ieP 
and R 
x*(t) = e%«' ay (4.66) 


is the unique solution of (4.65). 


For the LQ exact potential differential games r®, the control law KP) = RP) BO "pe 
is obtained from the optimization of the potential function (4.11), which is used to compute the 
feedback system dynamics 


PIESA, EN ea, (4.67) 


29 In the static case, the decision procedure to find the NE is the focus of the analysis. For a given distance between 


two static games, an approximate NE with an e limit is obtained, which is called the e-NE of the game. For more 
information on the near potential static game and the concept of e-Nash Equilibrium, it is referred to [COP13] or 
[Nis07, Chapter 19]. 
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where AP ) is calculated such that 
AP = A- BORO TBO pO), 


The solution of (4.67) is 
P(t) = A ty), (4.68) 


From the state trajectories a”) (t) and æ* (t), an upper bound (n) of the errors is provided for 
a given A between two games. For this, a notion for the difference between two closed-loop 
system behaviors is introduced in Definition 4.7. 


Definition 4.7 (Closed-Loop System Matrix Error) 


Consider an LQ exact potential differential game re) with the system trajectories (4.68). 


Furthermore, assume that an arbitrary LQ differential game Tna is an NPDG with the 
system trajectories (4.66). Then, the closed-loop system matrix error between re) and 


Tna is defined as 


AK = At - ACP, (4.69) 


Note: 

Two differential games are similar, if the closed-loop system matrix error is small and conse- 
quently, the system trajectories of these two games x* (t) and a”) (t) are close to each other. 
In this case, Iha is an NPDG. This closeness between an NPDG and an LQ exact potential 
differential game is quantified in Lemma 4.6. 


Lemma 4.6 (Boundedness of NPDGs) 
Let an LQ NPDG (see Lemma 4.5) Tna and an exact potential differential game ro) be 


given. Let the system state trajectories of the two games ro) and Tna be xP) (t) and 
x* (t), respectively. Moreover, 


ar’) (to) = æ* (to) = £o (4.70) 


hold for the initial values. 


Then, the error between the system state trajectories of Tnq and ro) are bounded by the 
function n(A) over an arbitrary time interval [to, tı], such that 


x(t) - x*(t)|, <n(A), Vee [to, ti]. (4.71) 
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Proof: 
From the solution of the differential equations (4.65) and (4.67), 


is obtained. As (4.70) holds, using Definition 4.7 and [Ber09, Theorem 11.16.7] leads to 


a*(t)-a)(t)|, = |e* pen A|, 


[O - =], < JAK], l ) [æo]: (4.72) 
In the following, an upper bound of AK is sought. Let the notation 


POL] [ ROBO TPA) 
PY, RQ Be) pe) 
Psp=| : |= ETE (4.73) 

(4) (i) G) p@® 

pP, R B P 
(m) agi pay 

Psp R B P 

be introduced. Substituting (4.66), (4.67) and (4.73) in (4.72), the upper bound 


IAK], = [poro Bo po -BOŞ RO BO po 


ieP 2 
- [Bo (RoBo po R Pye)| 
2 
E [Bo RO! (Bopo -ROP p) | (4.74) 
2 
is obtained. In addition, let the matrix 
RO - [RO RP, o, RP, ... Ro] (4.75) 


be defined where RË ) is the submatrix for the inputs ul’) of player i, for which 
R Psp = 2 RPE 


hold. Thus (4.74) can be reformulated to 


-1 T i 
|AK], - [BORO (Bo po) SRP 
<|B|, [RO I(e"'ro- TROPPO, IL, ae 
2 ieP 


Due to the well-known scaling ambiguity, there is a manifold of the potential functions (4.11) 
that result in an identical feedback gain matrix, thus a scaling factor k?” > 0 € R can be chosen 
such that JP) = K? - J(P) and 

JR], >1 (4.77) 
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holds. Assuming a suitable scaling, (4.74) leads to 


|AK|, < |B |, [pepo -E RPPO, 


ieP 2 
Then, let the following matrix be introduced 
T 1 
BO) PpP- RP PE, 
p- DU D |- u (Ppi) 
F-| BO p& _ ROPO -BP p®)_ > RP Pip (4.78) 


ieP 


T N 
BA) pP) _ Ry PSD 


The so-called Frobenius norm is defined as the entry-wise Euclidean norm of a matrix (see 
[BLR21]), for which 7 _ 

Fl, < [FIL a) 
holds (see [HJ17, Chapter 5] or [Ber09, Section 9.8.12]). Applying the definition of the Frobenius 
norm to (4.78), 


IF, = N-max([BO"P RMP, 


| IP iePp (4.80) 
2 
is obtained. 
Using property (4.79) and (4.80) leads to an upper bound 
a T A 
|AK|, < |B‘ IR |e” PP_Y RPL, 


ieP 
DU 


2 


< |B |, N. max pP) _ RO PO, 


# 


, 


Due to the scaling ambiguity, J“ = «’-J™, «’>0€ R holds and kê and k? can be modified 
to obtain R™ and RP), such that 


[B0 po RO RO BOTPO BOOTP) - BO TPO 


$ 
2 


2 


holds, for which 
po > IBO PO 


2 
is sufficient (see [Ber09, Section 9.9.42]). This leads to 


[RORO B 


(4.81) 
2 


i) T 


|AK]; < [B® |, N- max ||BO PP - BO'PO 


d 


= [B®], N-A. (482) 


Replacing the upper bound of AK in (4.72) by (4.82) leads to an upper bound for the trajectory 
error 


A 4] latl) 


n(A) = [BO |, N- A-t- e*l læoll (4.83) 
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such that 
2 t) -2*(t)|, < Cy,nppc(t)- A (4.84) 


holds, which proves the lemma. 


Remark 1: 

From (4.84), it can be seen that the upper bound of the DD governs the maximal admissible 
error between the trajectories, where the function n(A) depends only on the initial value, the 
system structure and the time interval [to, tı]. 


Remark 2: 
In (4.83), C,, nppa(t) is bounded in the time interval [to, tı ]. Thus, Lemma 4.6 holds Vt € [to, t1] 
only. However, A can be defined as 


A, Vte [to,t1] 
Ay Vte [t1,t2] 
A:=4: 
An Veen] 


In case of asymptotically stable system state trajectories x(t) and æ* (t), a monotonic 
decreasing series, An-ı < An, can be assumed preventing C, nppq(t) from an exponential 
growth for t > oo. Consequently, Lemma 4.6 also holds for t > oo. 


Remark 3: 

Note that Lemma 4.6 differs from the estimation of the distance between solutions of two 
general initial value problems: The upper bound between two general initial value problems is 
given as function of the Lipschitz constant and is usually proved with the Gronwall-Bellman 
inequality, see e. g. [Kha02, Theorem 3.4.]. On the other hand, Lemma 4.6 provides the link 
between the upper bound n(A) and the DD of the two games A, which differs from general 
initial value problems. Thus, Lemma 4.6 is a special case of Theorem 3.4. [Kha02]. 


Remark 4: 

The function C;, nppa(t) depends also on the number of the players, which seems to be a 
restriction. However, in human-automation interactions, there are generally only two players. 
For games, with N > 1, the players need to be assembled in subsets, then, the concept of 
NPDGs can be applied. 
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4.3.3 Computation of an NPDG 


For practical applications of the proposed NPDG, a computation method is necessary to find a 
potential function for a given differential game. Similarly to the trajectory-free optimization of 
OPDGs in Section 4.2.3, an LMI is formulated to find the parameters of the quadratic potential 
function. The LMI methods from [PCC*15] is adapted for the computation of NPDGs, analo- 
gously to the trajectory-free optimization of OPDGs. For the formulation of the optimization, it 
is assumed that A, B®, Q®, R© vie P, KP) are given for the optimization. The feedback 
gain K(P) is either directly estimated from measurements or computed such as 


K®) = [KY KO, EF KW] ; (4.85) 


The condition number of the concatenated matrix 


(p) 0 
E(nsy pieP) S | 0 ni| < BQ, RE(n+£ pieP) (4.86) 


is minimized, where E, is the unity matrix with n x n size. To find an NPDG, A must be 
specified in advance. On the one hand, choosing A large, the usefulness of Lemma 4.5 is 
weakened. On the other hand, small A values can not fulfill (4.56), and the LMI has no solution. 
Therefore, (4.56) is modified to 


BOT = BOPO 


max < Ba-A, (4.87) 
i 2 

where ĝa is an additional optimization variable, which is minimized through the LMI. This 
way, only an initial maximum distance A needs to be chosen and the LMI can reduce BA 
leading to a more strict condition. Furthermore, (4.81) and (4.77) also have to be fulfilled. 
The optimization variables (the outputs) of the LMI are QM) RP) Pp, Bar: Pa, while the 
inputs of the optimization are A, BO, QM, RO, Yi cP, K”. The LMI minimizes the sum 
of condition numbers q,r and Pa and it is subject to constraints providing a unique solution 
of the optimization. The resulting LMI problem is written as follows: 


QP, RO PR, Âo r, ĝa = argmin Bor + BA (4.88a) 

QP) R©) PP) Barba 
s.t. ATP) +PMA+ QM -P®BKO = 0, (4.88b) 
B®) pl) -RPKP) = 0, (4.88c) 

QP 0 

E< | 0 ROP) < Sq rE, (4.88d) 
max |BO'P® -BOPO <B,-A, (4.88e) 

$ 2 
[RORO BOTPO > [BOPO] vier, (ass) 

2 2 


IR], > 1. (4.88g) 
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The minimization of BAR + 6% ensures that the result of the LMI is unique and leads to the 


smallest admissible upper bound of DD. The optimality condition of the potential function J) 
is guaranteed by conditions (4.88b) and (4.88c). Constraint (4.88d) is necessary to obtain the 
unique solution. Constraint (4.88e) is the result of Lemma 4.5 restricting the identified potential 
function to be an NPDG. Using the additional condition number AA, the upper bound of the 
DD is reduced by the LMI providing a more strict condition. Constraints (4.88f) and (4.88g) are 
the results on the boundedness condition of NPDGs from Lemma 4.6. 


The limitation of the optimization algorithm is that A has to be chosen in advance, which can 
lead to non-feasible solutions. In this case, A has to be increased to obtain the solution of (4.88) 
and refined iteratively. 


4.4 Comparison and Discussion 


4.4.1 Simulation Comparison of OPDG and NPDG 


In this subsection, the proposed concept of NPDGs is applied to the illustrative Example 4.4. 
After the example, the three computation methods are compared to each other. The general 
notion of NPDGs is that for a given differential game the nearest exact potential differential 
game is sought such that the resulting NE trajectories are "near" to the ones of the original 
game. 


Example 4.4: 


Consider the differential game from Example 4.3. Similarly to the OPDG case, it is possible 
to find a substituting NPDG. Therefore, LMI (4.88) is applied and A is chosen as 0.15. The 
necessary computation time was 0.18s. The LMI (4.88) is solved with the same software 
as (4.47) (SeDuMi, version 1.3). 


The resulting matrices are 
(œ)  _ 10.958 0.039 
~ 10.039 1.005 |’ 


_ [0.980 0.024 
~ [0.024 0.997 |" 


The solution of the Riccati equation (4.21) is 


pm _ | 1.713 ve 


-0.263 0.365 
The obtained condition numbers are 
Ba = 0.243 and Bo,r = 1.030. 


The resulting trajectories are given in Figure 4.5. It can be seen that the obtained NPDG can 
provide trajectories similar to the original LO differential game. 
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Figure 4.5: The system state trajectories of the given original differential game (ODG) and the resulting NPDG 
are shown. It can be seen that the resulting NPDG can reproduce the trajectories of the ODG. 


The dynamics of the Hamiltonians are given in Figure 4.4, which show that the original 
differential game is not an exact potential differential game, thus (4.13) does not hold. However, 
the dynamics of the Hamiltonians are close to each other and the differences always remain 
within the defined A. The maximal DDs are 


max oS) (t) = 0.139 and max 0°) (t) = 0.093, 
for which (4.55) holds showing that the differential game is an NPDG. 


a) Hamiltonian of player 1 a) Hamiltonian of player 2 


Time in s Time in s 


Figure 4.6: The dynamics of the Hamiltonians H(V, H?) and HCP): The given original differential game (ODG) 
is compared to the NPDG found by the LMI. 
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To compare the three computation methods, normalized error measure (see e.g. [IC21]) is 


defined such as 
€x =MAX {Ey , Cx; -3 Can} (4.89a) 
x*(t) 39 (2) 


> max leo| 


Vje {1,2,. n}, (4.89b) 
212 


where a?) = [ar 2), shh a] are the system state trajectories obtained from one of the 


potential games (OPDG or NPDG). Then, x* = [x1,x3,...., x/,] are the state trajectories of the 
NE of the original differential game. In Table 4.1, the resulting error measures are given. It can 
be seen that, on the one hand, NPDGs can be applied more generally. On the other hand, an 
NPDG leads to a larger normalized error measure compared to OPDG-TF. The reasons for that 
are the additional conditions, which restrict the possible solutions. A limitation of OPDG-ITD 
is that it requires an initial parameter vector, which can have an impact on the optimization. 


Table 4.1: Comparison of normalized error measures of the NPDG with OPDG 
| OPDG-ITD | OPDG-TF | NPDG 
0.15 | 26.9 0.18 


Computational time in s 


ex [-] 0.0019 8.4-1074 | 0.0041 


4.4.2 Limitations of OPDGs and NPDGs 


The two novel subclasses, proposed in this thesis, offer a compact representation of the original 
game opening up potential applications beyond designing LISC. However, it is important to 
acknowledge the limitations associated with the current methods presented in this thesis, which 
are addressed as follows. 


First, the input-trajectory-dependent computation of an OPDG can be time-consuming and 
impractical for some applications due to its dependence on the system state trajectories x. 
On the other hand, the trajectory-free optimization to find an OPDG can be applied only for 
special system structures. Moreover, no necessary and sufficient conditions are provided for 
the existence of an OPDG. In the case of NPDGs, the applicability is only shown for two-player 
games, necessitating further research to address solution concepts for N-player games. 


Despite these limitations, this thesis marks the pioneering analysis and investigation of OPDGs 
and NPDGs, initiating new research directions. As such, these two novel subclasses hold 
significant relevance and importance for the research community in the field of differential 
game theory. 
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4.5 Systematic Calculation of the Cooperation State 


For a short reminder, the proposed design procedure of LISC has the following steps, see 
Figure 3.4 in Section 3.3: 


1 Design of a FISC, 

2 Computation of a substituting model of the differential game, 
3 Calculation of the parameters in CS, 

4 Computation of the feedback gains of LISC. 


Sections 4.2 and 4.3 handle the design step 2: The novel subclasses of potential games provide a 
more compact substituting model. In the following, the steps 3 and 4 are presented in detail. 


With the two novel subclasses of potential games, a substituting model of the differential 
game is obtained, from which, the CS of LISC can be derived systematically. The restriction of 
OPDG to two-player problems does not lead to further limitations because human-automation 
interactions can be always reduced to a two-player differential game [Fla16]. 


In the following, the derivation of the CS is presented based on the optimality principle of the 
identified potential game. First, let it be assumed that the quadratic potential function J) 
cf. (4.12) is computed with the developed methods. The NE of the original game corresponds 
to the optimum of the potential function. Therefore, using this optimum is reasonable to 
determine the CS. To find the optimum of the potential function, the dynamic optimization 
problem constituted by the potential function (4.12) and the linear system dynamics (4.9) has 
to be solved: 


oH) (t) AO) ENG 
u(t) = RY? U P (t) + BP A P (t) = 0, (4.90a) 
(p) 
&(t) = ern = Ax(t) +B u(t), (4.90b) 
(p) 
ade en = -Q) x(t) - ATAP (t). (4.90c) 


The resulting optimum of the potential games is computed with standards dynamic optimiza- 
tion methods see e. g. [PLB15, Chapter 12], which corresponds to the NE of the original LQ 
differential game. Furthermore, using conditions (4.90), an distinct relationship between the 
measured and non-measured states and the control inputs of all players is derived. By assuming 
a linear relationship between co-states and states 


AP (t) = P x(t), (4.91) 


and considering infinite time horizon, time-independent matrix pP), the time-derivative of 
the co-state is 


AP A) POEA). (4.92) 
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Substituting (4.91) and (4.92) in (4.90c) leads to 
PP i(t) = -Q® a(t) - A'PPx(t), (4.93) 
Applying system dynamics (4.90b), 
PP) (Ax(t) + Bu) (t)) = -QM a(t) - ATP x(t) 
results, which can be rewritten as the function of input u”) (t) 
a(t) =- [PPA + QP + ATP] POBu” (t), (4.94) 


where the index + denotes the Moore-Penrose inverse”. Using (4.94) the weights of the linear 
CS in (3.39) can be systematically derived aiming at a better understanding of the CS. Note that 
using the Moore-Penrose inverse leads to an approximate mapping between the inputs and the 
system states. In general case, x is determined by the solution of differential equation of the 
dynamics system cf. Definition 4.2. 


Assuming two players (the automation and the human) and a division of the states into measured 
and non-measured ones leads to 


[zat] --(peacq®eatroy' pon] 4), am 
== 
which can be rewritten to 
(a) 
keebi zillkew aso 
The CS for linear systems is defined as 
Eom (t) = Bu (t) + EMU (t), (4.97) 


for which the weighting matrices are computed from (4.96). If £ (t) := £um(t) is assumed, 
then the matrices E and =“ are computed such that 


=) = 251 and A) = XQ. 


4.6 Design of the Feedback Gains 


After the computation of the parameters of CS (Step 3), the computation of the feedback gains 
is presented in the following section (Step 4), cf. Figure 3.4. 


30 Note that the Moore-Penrose inverse is computed as Gt = (GTG)-!GT and always exists regardless of the 
dimension of the matrix. 
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Design with simulated human inputs 


Using the first method to determine the parameters a. and RO, the shared control setup is 


simulated with FISC. Then, the simulated input signals of FISC, uk? o is used for the parameter 
computation, which happens with the nested optimization 


(a) (a) (a) (a) 
uso Risc = arg min lukot) - une (t. Ic Ritkc)|, (4.98a) 
Qiise Riise 
w.r.t. (4.98b) 
w(t) =arg min JO o(t, e(t), u® (t), u™ (t)) (4.98c) 
ua) 
w.r.t. (3.40) and (3.44). (4.98d) 


Optimization (4.98) has two steps. The inner optimization ensures the optimality of IRo 
leading to an optimal controller. The outer optimization ensures that the inputs of LISC and 
FISC are as similar as possible. 


Design with measured human inputs 


The second method includes the usage of measurement data of a human operator carrying 
out the task with FISC, which can be used for individualizing LISC, which is presented in 
[VIH21]. Such an individualization process is also practically feasible, as the human can first 
control the system in an artificial setting (e.g. test area, simulation), in which the use of FISC 
is possible because all the system states and references are available. Using FISC, the desired 
input-output behavior of the system is sought. For that, an FISC is design according to (3.24), 
which provides feedback gain Krisc. In the next step, Krisc is applied together with the 
human controlling the manipulator. In this setup, the resulting automation inputs u([k], 
the inputs of the human operator u“”)[k] and the system states x„[k] are measured. In this 


way, three stacks consisting of MM), data points of the signals are obtained. Finally, Ki is 


computed with a least squares estimation using these measurements: 
(a) SE (al (a) ? 
a . a a 
KO) =argmin Y (a olk + KiRowelk]) - (4.99) 
Kıisc k=1 


Then, the individualized LISC can be applied in situations, in which the references or the system 
states are not available for the automation. Note that the computed feedback gains are not 
necessarily the optimum of the cost function (3.42). The schematic illustration of the controller 
design can be seen in Figure 4.7. 


To summarize the procedure, the three steps of the proposed personalized design are 
1. Designing a FISC by solving (3.24). 
2. Using FISC and measuring the signals u‘” [k], u™ [k] and &,[k]. 
3. Designing the personalized of LISC with (4.99). 
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The advantage of this second method is that the feedback gains can be personalized for the 
individual operators. However, further analysis showed that this parameterization is less robust 
compared to (4.98), for more details see [VIH21]. 


[| Automated | 
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Figure 4.7: The design procedure of LISC through input matching with FISC, which yields the desired parameters, 
[VIH21] ©2021 IEEE 


4.7 Stability Analysis 


To ensure the practical applicability and reliability of the proposed design procedure, its stability 
analysis is necessary. The system equation (3.40) is used for this analysis. The stability of LISC 
was exemplarily examined in [VSL*20]. The main challenge is that the influence between the 
human-controlled and the automation-controlled system parts are taken into account through 
CS. The question needs to be answered, whether the stability of the overall system is still 
ensured by the LISC structure with CS. Therefore, this section provides a general analysis, 
which takes both the human-controlled and the automation-controlled parts (shortly the overall 
system) into account. 


A schematic illustration of the relationship between the system equations is given in Figure 
4.8. It shows that the overall system includes two autonomous system parts: The automation- 
controlled part (Gm) and the human-controlled part (Gym). For the stability analysis, the two 
connections (y,, and u(")) marked in Figure 4.8 are important. Note that in accordance with 
Assumption 3.2.2, Gnm has no direct impact on Gm. The main question is how the connection 
these two subsystems influences the stability of the overall system. 


During the control design, the measurable system part has to be taken into account: The 
stability of Gm is ensured by the automation. Thus, first, the closed-loop behavior of Gm is 
analyzed. 


82 4 Systematic Design of LISC: A Potential Game Approach 


L4==2-1------------- E -- Ym 
Aee a SS 55525255 a (System 
coupling) 


Cooperation 
Pg 


Automation-controlled 
pi ie stem part 


Automati —— 


Figure 4.8: The schematic illustration of the overall control system is shown. The stability analysis includes two steps: 
First the stability of the subsystem G'm has to be ensured (orange + green blocks). Then the combination 
of Gm and Gnm (blue blocks) needs to be analyzed. Note that Gnm does not have a direct impact on Gm, 
cf. (3.27). 


Lemma 4.7 (Stability of the LISC-controlled system part) 
Substituting (3.41) in (3.40) leads to the closed-loop structure of Gm be defined such that 


Bea 0 Im (t) 
(a) (a) a 
50, “Ruse. “Ruse ul) (t) 
-B@ KY ISC,1 ER 63 -E0 Kifo, 3 a(t) 
a 
Am,c 


a) (t), (4.100) 


where KO o ;„ i= {1,2,3} are the feedback gains of LISC. Furthermore, let it be assumed 


that ù™ (t) is a bounded and Lipschitz continuous function. Moreover, u®)(t) > 
0 as t > œ. If Am, has only eigenvalues with negative real part, then (4.100) is 
asymptotically stable. 


Proof: 
The proof is obtained from the stability of linear systems, see e. g. [Kha15, Lemma 3.2] 


To enable the analysis of the overall system behavior, in the following, the non-measurable 
system part with the human control actions is taken into account. An adequate assumption of 
the human controlled system part is that Gym is stable as long as Ym is bounded. In that case, 
Ym is an external disturbance for Gym, which is compensated by the human. The practical 
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reason for this assumption is that the human is able to control the subsystem as they are trained 
to do. Adding Gm to Gnm and extending it with CS, the overall system is obtained 


E,&o(t) = Aoa,(t) + B® a (t) + BO a (t), (4.101) 
which is a differential algebraic system, where the matrix E, is given such as 
Enk 0 0 0 0 
0 Enp 0 0 0 
E=| 0 0 0 0 0 |, 


0 0 0 E 0 
0 0 0 0 Ep 


where the E, is an identity matrix with the size of n x n. The state vector, the system and the 
input matrices are 


Lolt)=[£m(t) U(t) zul) Emm) ui t)].7 


An B® 0 0 0 
0 0 oO oO 0 
A,=| 0 z% _E 0 BM], (4.102) 
Anum 0 0 An B® 
0 0 oO oO 0 
B® -[0 1 00.0] (4.103) 
B™=[0 0 0 0 af. (4.104) 


To enable an analysis of the overall system, a human control law has to be assumed, otherwise, 
its impact cannot be taken into account. The following control law of the human is assumed?! 


iu) (t) = -K¢) - x(t) - KH -u) (t), (4.105) 


from which the resulting human input is computed with J ah) (r) dr, which is a standard 
PI controller. Modeling the human behavior as a PI or a PID controller can be found in 
[HJ06, HMV19] or [Ort20, Chapter 2]. 


Lemma 4.8 (Stability of the LISC-controlled overall system) 
Let it be assumed that (4.105) holds. Furthermore, let the matrix 


Am B®) 0 0 
(a) (a) (a) mila (a) (h 
A stab = -Kīiīsc,ı -Kuisc,2 Kitso = 0 -Kitso l (4.106) 
p Am-um 0 Ann B 
0 0 KY KY 


31 The assumption of a preliminary knowledge of the human control law is feasible, as the FISC and LISC designs 
require it, cf. Section 3.2.2. 
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be defined as the stability matrix ofthe overall system. Then, the system (4.101) is stable 
if and only if Re {A; (Asan)} <0, Vi=1,...,n. 


Proof: 


Substituting the control law (3.41) and (4.105) in (4.101) yields an autonomous closed-loop 
system. This is a differential algebraic system, where the system matrix is 


Ai B® 0 0 0 
-K _K®) _K@) 0 0 
LISC,1 LISC,2 LISC,3 
Abc = 0 —B(a) Ek 0 _=h) 
N 0 0 Anm B® 
0 0 0 KP Kh) 


Reordering the state vector to [x(t), u(t), &um(t), u™ (t), &.(t)], the closed-loop ma- 
trix of the overall system results as 


N B@) 0 0:0 
K Kè 0 0 i _K®) 
u LISC,1 LISC,2 Í LISC,3 
Aoc = Am-um 0 Anm B®) ' 0 ’ (4.107) 
0 0 KM) KP: o 
0 -EG 0 -E0 E 


where the differential and the algebraic equations are separated by dashed lines. To enable 
the stability analysis of the overall system, an indexreduction of (4.107) is carried out, see 
e. g. [LMT13, Chapter 1, 2] or [Lun16]. An indexreduction of (4.107) is always possible, since 
E; is a unity matrix. 


Then, using the definition of the cooperation state for the automation control law 


uu) (t) = -Kf o1 ` Lm(t) - Kees f u (t) = Bes 


= (a) (a) a (a) mla a _ lh h 
=-Kıısc,ı' Lm(t) - Klısc.a' u‘ (t) -Kyiso3 (= hears (t) Em. uf (t)) 


(a) (a) (a) (a a (a) —(h h 
=-Kyjsc,' E(t) - (Kies + Krisc,s= )) -uf (t) + Kfc sE. uf (t), 
(4.108) 


the explicit dependency of the cooperation state is eliminated. Substituting (4.108) into (4.101) 
leads to the autonomous system 


4.7 Stability Analysis 85 


L(t) = ) BO ) 0 r Lm(t) 
u(t) £ -Kikoa Kira, Kiho, EO 0 Ki gE ul) (t) ! 
Znm(t) Am-um 0 Anm BW”) Lnm(t) 
w(t) 0 0 KP KP u™ (t) 
ROSE 
Astab 
(4.109) 


If the matrix Astab has only eigenvalues with negative real part, the autonomous system (4.109) 
is stable [Kha15, Lemma 3.2] and the designed limited information shared controller of the 
overall system (3.43) is stable, which proves the lemma. 


The procedure of the stability analysis could raise the question of why the overall LISC design 
is not performed using this reduced system, cf. (4.109). Please note, that the use of the CS 
facilitates the systematic design of LISC. It has a practical interpretation, cf. Example 3.1 and 
provides a measure of the mutual effort of the human and the automation. 
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4.8 Summary of the Chapter 


This chapter reports a solution to the second research question by providing a systematic 
automation design of the LISC. The preliminaries on the theory of potential games for both 
static and dynamic cases are presented followed by a discussion on the limitations of potential 
games and the necessity of novel concepts. To this end, the subclasses of ordinal potential static 
games are extended for differential games. Afterwards, the necessary and sufficient conditions 
of the existence of NPDGs are presented. In addition, two computation methods are developed, 
which provide a potential function of the original differential game. The first one requires the 
state trajectories and the cost functions of the players to identify the potential function for 
the original differential game. On the other hand, for the second method, the computation is 
formulated as a linear matrix inequality problem and solely the cost functions of the players 
are required. Thus, this second method can determine the potential function more efficiently 
compared to first method. 


The concept of OPDGs works under some specific assumptions only. Therefore, the subclass of 
NPDGs introduced. The necessary and sufficient conditions of the existence of NPDG and an 
computation algorithm are presented. The computation is also formulated as an LMI, which 
provides the potential function of the NPDG. The two novel subclasses are compared to each 
other and the simulation results showed that both subclasses are able to provide a substituting 
model of the original differential game. 


The remaining section of this chapter elaborate on the third and fourth design steps of LISC: 
The systematic calculation of the cooperation state is based on the optimality principle. The 
computation of the feedback gain is realized by the use of two methods using a) simulations or 
b) measurements. In the final part of the chapter, the stability analysis of the proposed LISC is 
presented. In the next chapter, this design procedure is applied to a large vehicle manipulator. 


5 Application to Vehicle Manipulators 


In the previous chapters, the concept of the LISC and its design procedure using the CS and 
potential games are presented, which are applied to a large vehicle manipulator in this chapter, 
for the overview of the design procedure see Figure 3.4 in Section 3.3. Thus, the third research 
question of this thesis is answered in the following: The practical benefits of LISC and its design 
procedure analyzed and compared to the current state-of-the-art technical solutions. This 
application and the analyses take place in three successive stages: First, the general applicability 
ofthe design procedure is analyzed using simulations in Section 5.2 and Section 5.3. Second, 
LISC is tested in a complex simulation environment with a simulated human behavior in order 
to analyze the impact of the large roll and pitch angels. This stage is referred as qualitative 
analysis in the following. Third, three experiments with human test subject are conducted 
providing stronger indications ofthe practical usability of LISC, which is the subject of Chapter 
6, which are called experiments or experimental analysis in the subsequent. 


First, this chapter introduces the novel design models of the vehicle manipulator, which are 
published in two research papers [VMSH19, VH22]. Afterwards, the proposed design procedure 
including four steps is applied: In the first step, a FISC is designed for the lateral and the 
longitudinal shared control. Then, the second step is applied: Using the shared control setup 
modeled by a given differential game, the corresponding OPDGs and NPDGs are computed for 
the lateral and the longitudinal cases. From the potential differential games, the parameters 
of the CS are computed in the third design step, which is followed by the computation of 
the feedback gains of LISC by means of (4.98). Finally, the stability and the usability of LISC 
are analyzed in simulations. In order to enable an analysis under more realistic conditions, a 
complex simulation model is developed Section 5.4. Using simulations, the qualitative analysis 
of this complex simulation model and LISC closes the chapter. 


5.1 Design Models of a Vehicle Manipulator 


For the model-based control design, the longitudinal and lateral models of a large vehicle 
manipulator are presented in this section. To set up the models, the basic idea from Chapter 1 
that the human operator controls the manipulator and the automation controls the vehicle is 
used. This division serves the consistence of the following presentation and does not imply any 
limitation from the control engineering point of view, since both the human and the automation 
can be modeled as controllers of the system. 
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5.1.1 Lateral Model 


In the following, the principal geometrical relationships and the linear lateral model of the 
large vehicle manipulator are presented. The detailed derivation of the non-linear equations of 
motion is given in Appendix B.1. 


The vehicle manipulator consists of a vehicle and a manipulator subsystem, which both are 
modeled in the Frénet Frame,” relative to their given reference paths, Fyen and T'nan- The 
vehicle is characterized by means of the kinematic bicycle model, see Figure 5.1. It is assumed 
that the velocity vyen of the vehicle is quasi constant and the steering angle 


u =6 (5.1) 


is the input variable of the automation. The vehicle can be described through its position Pyen 
and orientation Oyen in the global frame (i, 7),. From this global coordinate system O, the 
states of the vehicle are transformed into its Frénet Frame (irv, jev)p Here, the vehicle system 
part contains two state variables: The lateral distance to the reference path d,cn between the 
points Pyen and P,., and the orientation error Adych = Oven — Ory, see Figure 5.1. 


The manipulator is modeled as a planar robotic arm relative to its reference I’ man, in its 
Frenet Frame (7:m,Jrm)p,,- In order to describe the manipulator subsystem, two variables are 
necessary: The lateral error dman and the orientation error of the manipulator AQman = Q- Qr, 
where a, is the reference length of the manipulator resulting from the given a, and the position 
of Pycn, see Figure 5.1. The detailed derivation of the non-linear model of the manipulator 
can be found in Appendix B.1. Inspired by models of hydraulic manipulators from literature 
[Rud18, PR18], two input variables of the human-controlled manipulator are assumed 


u®) ze [ädes; Qdes | ’ (5.2) 


Figure 5.1: The lateral design model for the FISC and LISC design of the large vehicle manipulator [VMSH19]. 
©2020 IEEE 


32 For the modeling of wheel robots in the Frénet Frame, it is referred to [BK16, Section 49.2]. 
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which are the desired velocity and position of a and a, respectively. Using the geometrical 
relations between the global frame and Frénet Frames of the vehicle manipulator, a non-linear 
model is obtained, see Appendix B.1. The linearization leads to a linear model of the vehicle 
manipulator with four system states 


T= [dian AQman; dveh, Adyen]" : (5.3) 


For a constant velocity vyeh, an LTI system is obtained with the system and input matrices 


0 0 0 0 
0 -1 0 0 
AG 0 O Wen 0 en 
0 0 0 0 
sina, ap COS Qr D vyeh 
~ny_| 0 1 (ay_| 0 
B 3 i ‚B Bel (5.4b) 
0 0 Uveh 


5.1.2 Longitudinal Model 


To apply LISC to the longitudinal control, the longitudinal design model? of the large vehicle 
manipulator is presented in the following. The system is also described in the Frénet Frame 
meaning that the references Srey, Srefy and Sref,m are additionally given. Using a general 
approach, the vehicle is modeled as a double integrator along its reference path [yeh in lon- 
gitudinal direction, see e. g. [LP17, Chapter 13]. As suggested in [Rud18], the manipulator is 
modeled as an integrator along its reference path I’ man. The system state vector of the vehicle 
manipulator is 


; T 
Llon = [Asyen; ASyeh; ASman | 


The first system state describes the longitudinal position error of vehicle Asych = Sveh — Sref,v; 
which is followed by its velocity error ASyeh = ŝveh — ŝrefv. The third state is the longitudinal 
position error of the manipulator Asman = Sman — Sref,m, See Figure 5.2 representing the 
longitudinal design model. The inputs of the longitudinal model 
h a 
u”) = Px and ul? = Sveh,des 

are desired longitudinal speed of the manipulator and the acceleration of the vehicle, respectively. 
The system and input matrices are 


010 0 0 
Ain ={0 0 0|, B=|1], B® =| 0 |, (5.5) 
010 0 K;oy 


where Kjoy is the gain factor of for human’s input. This model is used to design the FISC and 
LISC for a longitudinal sharing of the operator’s task, which are also computed as presented 
Section 5.3. 

33 


Note that sake of brevity, the matrices and vectors possess the index lon only in the case of the longitudinal design 
model. No index is used for the lateral model. 
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Figure 5.2: Illustration of the longitudinal design model in the Frenet Frame for the LISC design [VH22] 


5.2 Lateral LISC Design for a Vehicle Manipulator 


The first step of the proposed procedure is the design of FISC followed by the computation of a 
corresponding near potential differential game and the calculation of the parameter of the CS. 
Finally, a simulation demonstrates the principal usability of the designed LISC. 


5.2.1 FISC Design for a Dual Task 


This subsection provides the first application of the FISC for a dual task in accordance with 
Definition 2.2. Note that in [Fla16], the adjustment of the controller parameters for a dual 
task was not taken into account, since both the automation and the human can carry out the 
task individually. However, in the case of a dual task, the modification of the global objective 
function J‘9) has a stronger impact on the overall motion. In case of a task prioritization 
problem of vehicle manipulator, cf. Definition 2.3, an inadequate design of FISC has stronger 
impact on the overall performance. 


The parameters of the lateral linear design model are given in Table B.1. The velocity is assumed 
to be constant Uyeh = 1.2 m/s, which is a typical operation velocity of large vehicle manipulators, 
see e.g. [MUL20]. 


To compute the optimal FISC, the operator model is used as given in Section 3.1.2. The human 
inputs are computed by (3.6) and the matrices of the cost function (3.14) are chosen to 


Q® = diag (4.5, 1,0.5, 0.5) (5.6a) 
R™ = diag (0, 1.05, 0.9) . (5.6b) 


The numerical values of Q® and R® model a general behavior of a human operator: The 
lateral error of the manipulator is more important than the other three system states. The ratios 
of these numerical values were determined empirically. One of the main challenges is properly 
choosing the global objective function J‘®) for a system with a dual task. The operator requires 
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smooth motions for both trajectories. Due to the mechanical coupling, the vehicle influences 
the manipulator. Thus, rough motions of the vehicle lead to undesired manipulator motion. 


The global objective function is quadratic, cf. (3.24) with matrices 


Q®) = diag ( Oh Qe os 2,08) = diag (5.5, 0.5, 1.25, 0.85) (5.7a) 
R® = diag (RP, RY& RO _) = diag (1, 1.45, 1.35). (5.7b) 


The choice of J‘ includes the following considerations: First, the penalty of the lateral error 
of the manipulator (Qi? ) should be larger than the penalty for the vehicle (Qi. ) due 
to the fact that reaching the reference of the manipulator implies the mutual effort “of the 
shared control setup and consequently has a higher priority. Through the ratio of these two 
values, the task prioritization problem (see Definition 2.3) can be solved. Second, changes of 
the vehicle’s orientation can be frustrating and counter-intuitive for the operator in contrast to 
the orientation error of the manipulator due to the mechanical coupling of the two subsystems. 


Therefore, gg „ 8 chosen to be larger than Q® 4 


Using the linear model (5.4), the parameters of the FISC can be computed by (3.24). The 
parameters are assembled into the 9) = (vec (Q) , vec (R®)). The obtained cost function 
of FISC has the following matrices: 


QG = diag (4.21, 3.37, 1.32, 0.35) (5.8a) 
RE = diag (1, 0, 0). 


The initial values of the optimization (3.24) are chosen to o0 = [5, 0.1, 1, 0.9, 0.1, 0, 0]. 
Thus, the FISC design leads to a differential game, in which the first player is the humatk and 
the second one is the designed FISC. From this differential game, the feedback gains of the 
players (K® and K®) are computed and the system trajectories can be simulated, which 
are necessary for the computation of the differential potential games. The initial value of the 
simulation was chosen to xo = [0.65, -0.75, -1.5, 0.25] . 


5.2.2 Computation of the NPDG 


The lateral model has one scalar input u(“) and one vector input u”). Thus, the methods of 
OPDGs cannot be applied, cf. Assumption 4.3.1-2 in Section 4.2. Therefore, an NPDG is sought, 
which can model this shared control setup. From the linear system (5.4) with the quadratic cost 
functions of the human (5.6) and the FISC (5.8) in Section 5.1, a quadratic potential function 
(4.11) is computed. 


Computation with perfect Feedback Gains 


For the computation of NPDG with the proposed LMI (4.88), K(P) is either estimated directly 
from the measurements of the system states and inputs or computed from the differential game. 
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Here, it is assumed that 


Kr) = [K™, K®] (5.9) 


holds, where K and K) are obtained from the solution of the human-automation differen- 
tial game, cf. Section 3.1.3. Using (5.8) and (5.6), P(® and P(®) can be computed by means of 
(3.20). Finally, the upper estimation of DD is chosen to A = 0.1 specifying all the necessary 
input variables of the proposed LMI optimization (4.88), therefore, a NPDG can be computed. 


The obtained matrices of the quadratic potential function J‘) (4.11) are: 


3.346 -0.064 0.081 0.021 
qm - -0.064 1.210 -0.149 -0.198 
0.081 -0.149 1.379 -0.409 
0.021 -0.198 -0.409 0.995 


1.008 0.011 -0.006 
and R® =| 0.011 1.275 -0.059]. 
-0.006 -0.059 0.987 


The result of the optimization variables are optimal Bg,r = 3.351 and BA = 0.860. The solution 
of the Riccati equation for NPDG is 


0.743 -0.171 -0.381 -0.944 
-0.171 0.565 0.079 0.348 
-0.381 0.079 2.555 1.765 
-0.944 0.348 1.765 3.779 


pl) -= 


Figure 5.3 shows the trajectories of the original differential game and the identified NPDG, 
which can reproduce the motion of the vehicle manipulators controlled by the shared control 
of human and automation. The error measure (4.89) is e, = 0.015 and the maximum DD is 


max of? = 0.055 < A, meaning that the game is a NPDG. This property can be observed in 


a 
Figure 5.4, in which the dynamics of the three Hamiltonians are given. 


Computation with Estimated Feedback Gains 


In the following, it is assumed that KM ie {h,a} in (5.9) are estimated from measurements 
of the state and the control trajectories of NE with a least square estimation. For the estimation, 
a finite sequence of sampling times tx, k € [1,..., Mp] is given for measuring the trajectories. 
Then, the feedback gain of player i is estimated, such as 
PO) NL) @ «ppl? 
K = argmin >) ||u [k]- Ka [ell , (5.10) 
KO k=l 7 


where u) [k] and a[k] denote the measurements at time tg. Note that in during the design, æ 
is assumed to be given, cf. Figure 3.2 in Section 3.2. In case of real measurements, the signals 
usually have measurement noise. In order to analyze the robustness of NPDG against noise, 
white Gaussian noise is added to the NE trajectories of the original differential game 


z(t) =a*(t) + olt), (5.11) 
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Figure 5.3: The resulting noise-free trajectories of the original differential game (ODG) with solid lines and the NPDG 
with dashed lines are shown. 
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Figure 5.4: The dynamics of Hamiltonian functions in the noise-free case are shown, where the blue solid lines are 
the right side of (4.13) obtained from the original differential game (ODG) and the red dashed lines are the 
left side of (4.13) being the result of NPDG. 


which is use to analyze the properties of the NPDG as function of the noise level defining 
through the signal-to-noise ratio (SNR). For measuring the deviation of the NPDG from the 
original differential game, the maximum DD max of (t) and the maximal trajectory error 
max (||?) (t) - a*(t)|,) and the error measure (4.89) are used. The results are given in 
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Figure 5.5: The resulting trajectories of the original differential game (ODG) with solid lines and the NPDG with 
dashed lines for SNR= 20 dB 


Table 5.1. Moreover, the maximal values of A are shown which ensure the feasibility of (4.88). 
It shows that the smaller the SNR value, the greater the DD and the A which is necessary to 
ensure the feasibility of (4.88). Roughly speaking, this implies that the identified NPDG is less 
similar to the original differential game with increasing noise. 


Still, the proposed algorithm can provide similar trajectories with NPDG compared to the 
original differential game maintaining a small distance, see Figure 5.6, which show the dynamics 
dH (t) dH") (t) 
dul) (t) and dul (t) 

i € {h,a} have similar trajectories and the distance between them is small, fulfilling (4.55) 
from Definition 4.6. Consequently, the original differential game is a NPDG. As a result, the 
computed cost function with the parameters Q(P) and RP) can fully replace the original game 
without losing essential information. 


of the Hamiltonians having a SNR= 20 dB. It can be seen that all derivatives 


Table 5.1: Results of NPDG computation with different white Gaussian noise levels, SNR=oo is the noise-free case 


SNR in dB | max 0 (t) max (|æ (t) - v(t) I.) Cx A 


10 0.359 0.786 0.012 0.5 
20 0.154 0.249 0.012 0.2 
30 0.058 0.098 0.011 0.1 
40 0.022 0.058 0.008 0.1 


oo 0.009 0.044 0.008 0.1 
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Figure 5.6: The dynamics of Hamiltonian functions, the blue solid lines are the right side of (4.13) with SNR= 20 dB 
and the red dashed lines are the left side of (4.13). 


5.2.3 Design of the LISC and Analysis in Simulations 


From the identified, noise-free NPDG, the matrices =) and &) of the CS can be computed 
as presented in Section 4.5. The obtained matrices of the CS are 


=h) _ 0.143 0.309 
=  ~1-0.030 0.349]° 


Using these identified parameters =) and B), the extended state vector cf. (3.35) of LISC is 
set up for the lateral control of the vehicle manipulator based on Section 3.2.2 such that 


zelt) = [dyen(t), AOven(t), E(t), zalt), %e2(t)]. (5.12) 


To compute the feedback gains of LISC, optimization (4.98) is used. The obtained optimal 
feedback gain is 


KC) = [38.62 76.91 51.46 -46.06 -14.71], (5.13) 


which enables the shared control of the vehicle manipulator with limited information. To 
analyze the stability of the vehicle manipulator system, the numerical results are substituted in 
Astab, cf. (4.108), and the eigenvalues A (Astap ) are computed, which are 


A (Astab) = {-30.81, -1.43 + 0.491, -0.44 + 1.091, -0.45 + 0.66%}, 


proving the stability of the overall system, since their real parts are negative. 
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After the design and the stability analysis of LISC, its effectiveness is demonstrated in a 
simulation, in which both LISC and FISC are applied. To obtain the simulation model in this 
first setup, the lateral design model of the vehicle manipulator (5.4) is extended with a time lag 
of 0.155 for the human input. This time lag models the human perception lag and is supported 
by literature, see e.g. [Heg08, FTCZ10]. References of the vehicle and the manipulator are 
defined leading to the system 


&(t) = Az(t) + BO u™ (t) + Bu (t) + rven(t) + Pman(t). (5.14) 


The reference paths ryen and frman are shown in Figure 5.7. The FISC uses every element of 
the state vector (5.3), in contrary, LISC requires (5.12) excluding the non-measurable system 
states. 


The results are illustrated in Figure 5.7. It can be seen that the trajectories of the two controllers 
are close to each other, indicating that LISC can provide a similar support. The support of the 
shared controllers can be observed in two cases: First, the vehicle does not track its reference 
as accurate as it could, if it supports the human to reach the reference of the manipulator faster, 
see e.g. at x x 5mor x» 15m. Second, the vehicle leaves its reference to assist the human 
with tracking the reference of the manipulator more accurately, see e.g. x » 10m and x » 37m. 
This behavior of the automation is the result of the prioritization of the dual task, which is 
achieved by the suitable choice of J‘). 


Manipulator FISC = = = Manipulator LISC 
Vehicle FISC = = = Vehicle LISC 


Manipulator Reference 
Vehicle Reference 


y distance in m 


-1 C ji ii | ji ji jl l = 
0 5 10 15 20 25 30 35 40 
x distance inm 


Figure 5.7: Comparison of the trajectories obtained form the lateral control of the vehicle manipulator using LISC and 
FISC in simulation 
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In order to evaluate the design LISC, the performance index for the evaluation is defined as the 
average tracking error 


Tend 
davg,m = i dman(t) dt, (5.15) 
0 
since the mutual effort of the automation and the operator is a precise tracking of the reference 

of the manipulator. 


The resulting trajectories of FISC and LISC look very similar, which raises whether LISC always 
works that well. The first reason for the good correspondence is the use of the design model 
of the vehicle manipulator as the system plant in the simulation. The second reason is that 
the applied model of the human operator J®) is fixed and does vary during the simulation. 
Thus, the determined CS can represent the mutual effort perfectly. The average tracking error 
of FISC and LISC are 


davg,m,LISC = 0.14m 
davg,m,FISC > 0.16 m, 


which also indicate that the LISC can provide a support similar to FISC. 


For further analyzes, an extension with a more complex simulation model and the replacement 
ofthe human’s model, which are addressed in the subsequent: Section 5.4.2 presents analyzes 
with a complex model of the vehicle manipulator and the experiments in Chapter 6 include 
human test subjects. That way, both discussed limitations are addressed. Still, the simulation 
of this section provide the first indications that the use of a lateral LISC is suitable for the 
replacement of FISC. 


5.3 Longitudinal Control of a Vehicle Manipulator with 
LISC 


The realization of the longitudinal shared control of a large vehicle manipulator is presented in 
the following. The controller design procedure has the steps as given in Section 4.5. For the 
design, the longitudinal model of the large vehicle manipulator from Section 5.1 is used. 


5.3.1 Full Information Shared Controller 


First, an FISC is designed using J (g IR the global cost function, which is quadratic cf. (3.13), and 
its weight matrices are 


(9) = diag[1, 1,10] and Rion = diag[0.5, 1], 


which models that the deviation of the manipulator from its reference has a higher priority 
compared to the velocity and position errors of the vehicle. Furthermore, based on Section 
3.1.3, quadratic cost functions of the automation and the human are assumed. Based on 
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preliminary analysis, anominal human model is used for the FISC design with the following 
weight matrices 


() - diag (1, 1, 5) and R® = diag (0.25, 1) 


lon ~ 


modeling that the primary goal of the human is the tracking of the manipulator’s reference 
Sref,m- The weighting matrices of FISC are designed by the optimization (3.24) yielding 


© sc = diag (0.345, 0.076, 1.409) 


Ri” pisc = diag (1.00, 0.190), 


from which the feedback control laws of the human and the automation are computed by the 
coupled optimization of (3.20) leading to the following result 


w -0.787, a 0.422 
K ion FISC =| 0.258, K on FISC = | 1.592 |. (5.16) 
1.430 0.830 


5.3.2 Computation of the Potential Games 


As the inputs are scalar, an OPDG can be computed, for which Algorithm 1 is used. In the 
case of ideal feedback gains of the player, K“) are obtained from the original game and the 
quadratic cost function of the identified OPDG has the following penalty matrices 


1.199 0.000 0.000 
QY? oepa =| 0-000 2.140 0.000], 
0.000 0.000 3.588 


RP = 1.000 0.052 
lon,OPDG 0.052 3.5841’ 


which leads to 


és 7.742 1.470 -5.479 
PO cepa | 1.470: 36.008 2.529 
-5.479 2.529 10.067 


The figures visualizing the results of noise-free OPDG are given in Appendix C.1. 


Using the measurements of a shared control setup should intuitively provide a better model 
than using simulated trajectories. The inputs ul, ur) and the state trajectories Xo, are 
attained from measurements, so they could be used directly in Algorithm 1 to identify the 
OPDG similarly to the NPDG case in Section 5.2.2. However, in general, measurements are 


noisy and consequently, condition (4.41c) in Algorithm 1 cannot be fulfilled around zero. 


A possible solution is that the measured trajectories are used for the computation of the input 
errors €,,, see (4.41a). Then, a data-preprocessing use the measurements to estimate the feedback 
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Figure 5.8: Preprocessing of the measurement signals for the inputs-trajectory-dependent computation of an OPDG 


gains of the players using (5.10), from which the system state trajectories are reconstructed 


though solving 
&(t) = xo -exp{(Aton = BK ise T BORO jiso) t). (5.17) 


Those reconstructed trajectories are noise-free and can be used for condition (4.41c) in Al- 
gorithm 1 solving the problem of the noisy system state trajectories. The notion of this 
data-preprocessing is illustrated in Figure 5.8. 


Then, for the analysis of the robustness, white Gaussian noise is added to the NE trajectories 
of the original game such as in (5.11). The error measure (4.89) and the computation time of 
Algorithm 1 are used to evaluate the input-trajectory-dependent computation method of OPDG. 
The resulting trajectories of the system states are presented in Figure 5.9 with SNR= 20 dB and 
Figure 5.10 illustrates the dynamics of the Hamiltonians. The results of the error measures and 
the computational times are given in Table 5.2 showing that noise increases the computational 
time and the error measure. However, as the system state trajectories indicate, the original 
differential game can still be reproduced despite using noisy signals. 


Note that the trajectory-free optimization for the OPDG computation is robust against noisy 
measurements since it uses only the definition of the original differential game, but no input 
or state trajectories to identify the OPDG. Consequently, no robustness analysis needs to be 
provided. 


Table 5.2: Results of the input-trajectory-dependent computation method of OPDG with different white Gaussian 
noise levels are shown, where SNR=o is the noise-free case 


SNR in dB ex Computation time in s 


10 0.329 231.6 
20 0.123 164.2 
30 0.041 134.3 
40 0.013 133.5 


o0 0.003 119.9 
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Figure 5.9: The resulting system state trajectories of the longitudinal vehicle manipulator with noisy signals (SNR= 
10 dB) of the original differential game (ODG) and the identified OPDG 
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Figure 5.10: The dynamics of Hamiltonian functions, the blue solid lines are the right side of (4.13) with SNR= 20 dB 
and the red dashed lines are the left side of (4.13). 


5.3.3 Design of the LISC 


In the following, the longitudinal LISC is derived from the identified OPDG. For the calculation, 
the noise-free case is used. First, the parameters of the CS 


Ep lonlt) EM - pjoy(t) +E « 8 elt) (5.18) 


are computed with using the method from Section 4.5. The obtained parameters are €(”) = -0.547 
and €(“) = 0.312. Using CS, an extended system state is formulated such as 


Lion,e(t) = [Asyen(t), Asyen(t), Sven(t), Lx, lon(t)], (5.19) 
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which is used by LISC. Thus, a controller with limited information can be designed, which 
enables a similar shared behavior as a controller with full information. Its benefit is that no 
information about the manipulator reference is needed. The input of this extended system is 
computed by 


S veh = ~K( ) 


Ion LISC ` Zlon,e» (5.20) 


where the feedback law is 


K sc = [19-899 14.183 25.288 -9.862], 


lon,LISC 7 


obtained from (4.98). To prove the stability of the overall system, its eigenvalues A (Ajon,stab) 
are computed in accordance with (4.109). The obtained values 


A (Aton, stab) = {-21.595, —0.386 + 0.8142, -0.137, -1.135, } 
prove the stability of the overall system controlled with LISC. 


Finally, in a simplified simulation, the efficiency of the longitudinal LISC is demonstrated. For 
that the reference longitudinal position of the vehicle and the manipulator are defined as 


t 


Stefy(t) = Vref0,v ` t+ J Uvarv( T") dr, 


0 


Srefm(t) = Vref0,v ° t+ Srefo,m + Svarm(t), 


where Syefo,, and Srefom are the constant reference velocity of the vehicle and the initial distance 
between the vehicle and the manipulator, respectively, which are chosen to Uyefo.y = I and 
Srefom = 3.75 m. The functions Syarm and Vyary are variations of the manipulator’s position and 
the vehicle’s velocity, which need to be compensated by the controllers. These variations can be 
seen in Figure 5.11 and Figure 5.12. For the evaluate of the design LISC, the performance index 
for the evaluation is defined as the average longitudinal tracking error of the manipulator 


ASavem = i "S A Sman(t) dt. (5.21) 


Figure 5.11 presents the trajectories relative to the vehicle, where the results using LISC and FISC 
are compared. In Figure 5.12, the reference velocity and the velocities reached by FISC and LISC 
are analyzed. The supporting behavior of both controllers can be observed at t ~ 7s, t x 17s 
and t x 20s, where the vehicle leaves its reference position by decelerating or accelerating 
the vehicle, which can be seen in Figure 5.12. At t x 30s, the vehicle follows its reference 
slower compared to t = 3s. The reason for this reaction is that the automated vehicle helps the 
human-controlled manipulator to reach its reference more accurately. The result of (5.21) are 


ASavgm, FISC = 0. 11 m, 
Asıygm, LISC = 0.13 m, 
which are close to each other indicating that the support of LISC and FISC are similar as well. 


To summarize the section, the LISC design procedure using the novel subclasses of potential 
games works also for the longitudinal guidance of a large vehicle manipulator. Furthermore, 
the simulations are carried out for both the lateral and longitudinal shared control ofthe vehicle 
manipulator and their results indicate the general suitability of LISC. 
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Figure 5.11: Comparison of the trajectories obtained form the longitudinal control of the vehicle manipulator using 
LISC and FISC 
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Figure 5.12: Comparison of the trajectories obtained form the longitudinal control of the vehicle manipulator using 
LISC and FISC 
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5.4 Detailed Simulation Models of the Vehicle Manipulator 


After the development of the design models for a large vehicle manipulator and the application 
of LISC to them, this section presents the detailed simulation model, which can characterize the 
motion of a large vehicle manipulator more realistically than the simulations from Section 5.2.3 
and 5.3.3 enabling deeper analyzes. The complex simulation model of the vehicle manipulator 
is necessary due to the large pitch and roll angles of the vehicle. 


5.4.1 Simulation Model 


An "out-of-shell" overall simulator or simulation model does not exist in the literature, which 
would be suitable for the qualitative analyses and experiments of the proposed shared control 
concepts. Still, there are models of the subsystems in the state of the art, which can be combined 
to an overall simulation: Heavy-duty vehicles and large hydraulic manipulator were considered 
in literature [LH05, MHW*15, HB16, RAA*17]. However, their combination is novel and 
raises further challenges. Furthermore, the real-time implementation®* requires additional 
examinations. Parts of the implementation was done in the course of tow bachelor theses 
[Bur19, Bou19] and a master thesis [Mail8]. Furthermore, parts of this section were published in 
two research publications [VMSH19, VMH22]. Figure 5.13 shows the overall system including 
a mid-sized heavy-duty vehicle and a large hydraulic manipulator. 


Figure 5.13: The schematic illustration of the simulation model containing a tractor-like vehicle and a hydraulic 
manipulator with four joints [VMSH19] ©2019 IEEE 


34 A real-time implementation is necessary to enable the interaction between the human and simulation of the system 


dynamics in the experiments, see Chapter 6. Real-time means soft real-time in the following. 
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Model of the Vehicle 


The vehicle’s simulation model contains 
e the three-dimensional and non-linear vehicle body, 
e two two-dimensional suspensions and 
+ four wheels with a linear tire model. 


As the vehicle’s motion does not have high dynamics, a linear tire model is sufficient. On the 
other hand, large vehicle manipulators have larger roll and pitch angles than passenger cars, 
thus a non-linear vehicle body model is necessary. This is an essential difference compared to 
other vehicle models from literature. Therefore, the vehicle body motion model from [KNH14] 
is implemented in the course of this thesis, which can model larger roll and pitch angles 
accurately. 


To enable a real-time simulation, fixed-step discrete solver is necessary, which however can 
lead to numerical unstable dynamics of the wheel around 0m/s. A suggested solution is 
the introduction of a numerical threshold for the slip computation, see [Ril11, Chapter 4.]. 
Therefore, the slip of the wheel is computed as 
gz Uveh = Wwhe ' Twhe (5.22) 
max (veh; Wwhe * Twhe; un) 


where Uveh, Wwhe and Twhe are the vehicle velocity, the rotational speed of the wheel and the 
radius of the wheel, respectively. The parameter vn is chosen in accordance to maintain the 
numerical stability at low speeds. The vehicle body and suspension models are presented in 
detail in [KNH14]. For more details on the tire model, it is referred to [Ril11, Chapter 3.]. The 
vehicle is modeled in a global frame, the position of the subsystems are given relative to vehicle 
body. Further equations of motion of the vehicle are given in Appendix B.2. 


Model of the Manipulator 


The hydraulic manipulator consists of 
e four arm segments and 
e four hydraulically actuated joints, with the state vector & = [¢1, ¢2, $3, da], 


see Figure 5.13. The heavy arm segments and hydraulic actuators are modeled based on [FH15, 
Chapter 6.] [Rud17, RAA*17]. Additionally, a velocity based inverse Jacobian is added. This 
means that the operator does not directly control the joints of the manipulator with the joystick, 
but the speeds of the end effector (EE), see Figure 5.14. The general equations of motion are 
given relative to the vehicle body such as 


M¢(t) = Thya (Prya; Thya (t), u™ (t, ®)) 
+ T tric ($t), p(t)) + T mech (Dees Lyeh,sim(t)) ’ (5.23) 


where M is the inertia matrix. The right-hand side of (5.23) are the driving torques of the 
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Figure 5.14: The control structure of the hydraulic manipulator with coordinated rate control is shown, cf. Section 2.2. 
The manipulator is not automated due to the unstructured environment. The orange color symbolizes 
that a model of the human operator is used in the qualitative analysis. On the other hand, the green color 
shows that the models used in both qualitative analysis and experiments. 


hydraulic actuator, the linear and non-linear friction torques and the external mechanical 
influences, respectively. The driving torques of the hydraulic actuator depend on the hydraulic 
parameter Pnya and on the input of the human u) (&). The mapping of the human’s input to 
the coordinated desired angles of the manipulator is non-linear due to the inverse Jacobian, 
cf. Figure 5.14. 


The internal states of the hydraulic actuator xpya(t) are the oil pressure, the oil flow and the 
state of the electric motors which drive the valves for the hydraulic cylinders. The modeled 
frictions include a linear viscous component and a Stribeck curve using the LuGre friction model, 
which is a common approach for hydraulic systems, see e.g. [THY12]. The function T mech 
includes the torques and the forces caused by the motion of the vehicle. In (5.23), ® yeh sim 
denotes the vehicle state of the complex simulation model” and Pgeo includes the geometrical 
parameters relevant for motion generation of the manipulator. The parameters of the hydraulic 
manipulator are obtained from the literature, [ZGSF09, Ala12]. The detailed equations of 
motion and further information of the hydraulic manipulator are given in Appendix B.2.2. 


Implementation and Limitations 


The simulation models of the vehicle and the manipulator were implemented with Simulink, 
see right green block in Figure 5.15. The overall simulation model runs with 2kHz update 
rate and with a Runge-Kutta solver. The solver is chosen to ensure the numerical stability of 
the overall system: The oil model of the hydraulic cylinders has high frequency numerical 
oscillations with solvers of lower order. 


The simulation model can reproduce the motion of a large vehicle manipulator, still it has some 
common limitations. These are as follows: 


35 Note that vehicle’s the design model - presented in Section 5.1 - includes fewer states compared to the simulation 


model presented here. 
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Figure 5.15: The software structure of the simulations and experiments. The orange blocks are used only in the 


qualitative analysis. The C++ ROS-Nodes (Robot Operating System) are generated from the green blocks, 
which are used on the test bench for the experiments as well. 


1. There is no detailed combustion engine model, which is actually used in such machines. 


There is no thermodynamic model in the simulation. It is merely replaced by the first 
order transfer function based on the suggestion of literature, see e. g. [Hil16] or [HB16, 
Chapter 6.]. 


. The tires are only modeled in the linear slip range, the model does not contain the 


non-linear part of the -slip curve, see e. g. [Ril11, Chapter 3.]. 


3. The break system is modeled as an additional external torque on the wheels. 


4. The different hydraulic cylinders are not parameterized differently and each cylinder is 


modeled with their own oil tank. No common tank is implemented. 


These modeling assumptions are feasible and do not restrict the indication of the simulations 
and experiments since the main focus of the analyses was the testing of the LISC. Furthermore, 
the simulations and the experiments do not have the following goals: 


1. The energy efficiency and thermodynamic effects of the large vehicle manipulator was 


not optimized or analyzed. 


. Maneuvers with high dynamics were not taken into account (e. g. emergency break or 


testing of electronic stability program). 


. The dynamics and characteristics of the break system were not considered, since the 


scenarios include no sudden accelerations or deceleration. 


. The energy optimality and load carrying capacity of the hydraulic system components 


were not the focus of the analyses, thus the implementation of a common tank and an 
individual parameterization of the cylinders were unnecessary. 
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5.4.2 Analysis of the Simulation Models and the Designed LISC 


After setting up the models, they are analyzed with critical scenarios, which can demonstrate 
the benefits and the necessities ofthe three-dimensional and non-linear vehicle and manipulator 
models. Secondly, the general usability of the proposed LISC is verified, too. 


The test environment for the qualitative analysis includes four subsystems, cf. Figure 5.15. 
Environment models provide the references for the simulated human operator and for the 
controller to be able to control the manipulator and the vehicle, respectively. The colors green 
and orange have the following purpose: The two orange blocks are only used in the qualitative 
analysis. In the experiments, the human model is replaced by test subjects and the environment 
model by a graphical interface, see Section 6.1. On the other hand, the two green blocks are used 
in the experiments as they are. The complex simulation model of the large vehicle manipulator 
remains the same for both qualitative analysis and experiments. 


This test environment can provide the qualitative analysis of the proposed LISC. For a compari- 
son, a non-cooperative controller (NCC) is implemented omitting the supporting behavior of 
a shared controller. Since, the NCC does not take the manipulator into account, the system 
states are reduced to £yeh = [dyen, Aven]. The system and input matrices for the controller 
design are 


Aveh = l 3 and Byeh = fl , 


respectively. This is a common model for a simple vehicle representation, see e. g. [BK16]. The 
NCC is an LOR, which is designed by means of a quadratic cost function, in which penalty 
matrices are 


Qnec = diag ([1.25, 8.25]) and Ryce =; 
The control law obtained from the LOR design is 


Kncc = [1.12, 3.24]. 


For the testing and analysis of the vehicle manipulator model and the LISC, two scenarios 
are used: The first one includes a reference with a sudden step followed by a smooth curve, 
see Figure 5.16. In the second scenario, the reference trajectory of the manipulator is the 
combination of a smoother curve and a sudden step. This subsection presents the results of the 
first scenario. The second scenario and further details on the simulation results are given in 
Appendix C.2. 


In the simulation, the human model is used as given in Section 5.2.1. Figure 5.16 shows the 
schematic representation of the test scenario and the two reference paths of the vehicle (yellow 
path) and the manipulator (blue path). First the vehicle has a small correction in its reference 
at x x 20m. Such a correction is common due to changes in the traffic flow, which requires an 
adjustment e. g. for sufficient safety distance between vehicles. At x x 45m, the reference of 
the manipulator has a sudden step. This models a hidden obstacle (e. g. a large stone or a piece 
of metal, see red block in the figure), which could damage the manipulator. The operator must 
react to this. After that the vehicle manipulator enters a smooth curve. 


108 5 Application to Vehicle Manipulators 


The results of the qualitative analysis show that the sudden step of the manipulator has an 
impact on the vehicle motion, which can be noticed on its rotation angles, see Figure 5.17. Thus, 
the motion of the vehicle is not typical for state-of-the-art trucks or tractors: The vehicle is 
tilted around its longitudinal axis, due to the mass ofthe manipulator. Figure 5.17 shows that the 
roll angle of the vehicle is larger than 0.09 rad”, see e. g. [For16]. Therefore, a linear simulation 
model of the vehicle is not adequate and the implementation of the proposed non-linear model 
is reasonable, see Section 5.4.1. Figure 5.17 shows the influence of the manipulator: At t ~ 45s, 
the manipulator is stretched out, thus the torques on the vehicle are larger, which leads to a 
change in the roll angle. After t ~ 100 s, the manipulator moves back to the earlier position and 
the vehicle is rolled back. A small change in the pitch angle can be also observed: The vehicle 
is tilted during the maneuver between 60s and 100s. 


Further figures showing the vehicle motion (e. g. suspension’s and wheel dynamics) are given in 
Appendix C.2. From the discussion with professional operators, it is confirmed that a roll angle 
of approximately 22 deg is usual in challenging situations. The motion of hydraulically driven 
manipulators is characterized by a slow and delayed motion, cf. [RAA*17]. The hydraulic 
actuators can grant large torques, but have slow dynamics compared to electrical motors. As 
mentioned in Section 5.4.1, the operator uses a coordinated rate control, meaning that the 
desired velocities of the EE, &man,d and Yman,d are set (cf. Figure 5.14). From these desired 
velocities, the desired angular velocities of the manipulator are calculated with a numerical 
inverse kinematic algorithm. These desired angular velocities are then set by the low-level 
controller of the hydraulic actuators, cf. Figure 5.14. For more details on the low-level controller, 
it is referred to Appendix B.2. 


The desired and actual angular velocities of the manipulator during the test scenario are given 
in Figure 5.18. The characteristic slow motion of the manipulator is similar to the available 
results from literature indicating the suitability of the simulation model for the experiments. To 
analyze the modeled hydraulic system, Figure 5.19 shows the simulated oil flow (Qoit) and the 
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Figure 5.16: Schematic illustration of the test scenario with two reference paths of the vehicle (yellow path) and 
the manipulator (blue path). Please, note that the scaling of the axes x and y are different for a better 
visualization of the scenario. 


36 It is a common engineering practice that the sin and the cos of an angle can be linearized, if they are smaller than 


0.09 rad which corresponds to around 5°. 
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Figure 5.17: The pitch and roll angles of the vehicle. The influence of the manipulator’s motion can be seen at t x 50s. 
The figure confirms the necessity of the non-linear vehicle model: The roll angle varies between 0.2 and 
0.4 rad, which is larger than 0.09 rad meaning that the linearization error would be too large. 
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Figure 5.18: The desired and actual angular velocities of the four joints. Their motions are slower compared to electric 
actuators. Results from literature have similar characteristics. 
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pressure (Po) in the hydraulic actuator of the third joint. Their characteristics and magnitudes 
also correlate with the results available from the literature. It can be seen that during the sudden 
maneuver at t » 45s, the pressure and the oil flow are increased to provide the necessary torque 
and power to move the joint. In the smooth curve at t x 100s, the pressure returns to an 
approximately constant oil pressure level. As a result, the oil flow is approximately zero. Such 
a behavior can be observed in state-of-the-art works [FFV16, KZM19]. 


To summarize, the simulation model is suitable to characterize the complex motion of the 
vehicle manipulator. For a qualitative comparison of the results from the state of the art, it is 
referred to [LHOM15, Rud17, YVF17] 
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Figure 5.19: The hydraulic flow and pressure of the 3. actuator of the manipulator. 


The second goal of the considered simulation is the testing and analysis of the proposed LISC. 
The goal is that the simulated operator can carry out the dedicated task - the path tracking - 
with LISC better than aNCC. The NCC, implemented for comparison, corresponds to the most 
obvious control scheme of the system: The vehicle is automated, while the operator can devote 
himself fully to the tracking tasks with the manipulator. In the simulation, the mental load, 
intuition ofthe human operator or similar aspects are not taken into account. 


Sharing the task means that the vehicle moves together with the manipulator to minimize the 
error of the manipulator in situations, where the manipulator cannot reach the desired goal. On 
the other hand, this sharing should not be active in situations, which the operator can handle. 
Both situations are represented in the simulation scenario: A sudden step and a smooth curve, 
see Figure 5.16. 
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Such a sharing of the task between the automated vehicle and the human-controlled manipulator 
is beneficial for both the quality ofthe work and the expenditure of time. The results of the 
simulation with LISC and NCC are given in Figure 5.20. During the change of the vehicle’s 
reference at x x 20m, the NCC does not consider that the motion of the vehicle has an impact 
on the motion of the manipulator. Therefore, a more significant correction by the operator 
is necessary. In addition, it can be seen that by the sudden step at x x 45m, the manipulator 
cannot reach the reference as fast as it is possible with LISC. The vehicle leaves its own reference 
to help the operator to reach the goal with the manipulator. This maneuver is not possible with 
the NCC and would probably lead to the damage of the manipulator. 


On the other hand, at x » 120m, the large curve begins, in which no support is necessary for 
the operator. Therefore, LISC does not provide support and therefore, LISC does not lead to a 
noticeable difference between the trajectories of NCC and LISC. 
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Figure 5.20: A Comparison between the system trajectories of using LISC and NCC is shown. It can be seen that the 
manipulator can track the reference path more precisely using LISC than NCC. 
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5.5 Summary of the Chapter 


This chapter presents the application ofthe LISC design procedure to alarge vehicle manipulator. 
First, two design models - for the lateral and longitudinal motions - of the vehicle manipulator 
are developed enabling the usage of the concepts presented in Chapters 4 and 3. Then, the 
chapter elaborates on the design of the FISC for problems with dual goals, where the emerging 
challenges are addressed. In the next steps of the lateral LISC design, aNPDG is computed and 
its robustness against noise is investigated. In the case of the longitudinal LISC, an OPDG is 
computed. In case of noisy signals, the limitation of the OPDG is solved by the preprocessing 
of the system state trajectories, which enables the use of the input-trajectory-dependent 
computation methods cf. Section 4.2.3. Then, LISC is compared to FISC in the two simulations: 
The first includes the lateral motions of the vehicle manipulator and in the second one, the 
longitudinal shared controllers are analyzed. The results show similar system state trajectories, 
which partly answer the third research question and indicate the general applicability of LISC. 


Section 5.4 describes the implementation of the simulation models and their qualitative testing 
and analyses. The challenges and the proposed solutions for the real-time implementation of 
the models are addressed as well. The qualitative analysis is performed by means of a test 
scenario. The results demonstrate the general usability of the simulation models and further 
explanations are given as to why the non-linear simulation models are necessary. Finally, the 
fundamental functionality of the proposed LISC in a complex simulation is demonstrated by 
comparing it with a non-cooperative controller. 


6 Experiments 


In this chapter, three different experiments are conducted demonstrating the benefits of LISC 
and demonstrating its applicability in real world applications with human test subjects. This 
way, third research question, on the application of the control concept and the design procedure, 
is completely answered, see Section 2.4 These experiments are carried out on the developed 
simulator using different setups of the human control interfaces. They focus on the following 
aspects: 


« Comparing LISC with FISC and NCC for the lateral motion of the large vehicle manipu- 
lator, 


e Comparing LISC with manual control for the lateral motion of the large vehicle manipu- 
lator, 


e Comparing LISC with NCC for the longitudinal motion of the large vehicle manipulator. 


6.1 Test Bench and Measures of the Experimental 
Evaluation 


By reason of the special application of the vehicle manipulator, in the subsequent paragraphs, 
the real time test bench with its hardware and software structure is presented followed by the 
discussion on the experimental evaluation measures, which is necessary due to the lack of sys- 
tematic evaluation and performance criteria for vehicle manipulators in the road maintenance 
[Rec16]. 


6.1.1 Hardware and Software Components of the Test Bench 


To enable experiments of LISC with human test subjects and to provide indications for the 
practicability of the proposed concepts, a simulator of a large vehicle manipulator is neces- 
sary. Unfortunately, there are neither open-source simulators nor other professional software 
available that would provide a real-time capability, an easy accessibility of the software inter- 
faces and a graphical user interface, which are necessary for human-in-the-loop experiments. 
Therefore, a simulator has been built in the course of this thesis, which is suitable for the 
experiments that demonstrate the usability of the proposed LISC with the vehicle manipulator 
application. 


Figure 6.1 shows the test bench used for the experiments. It consists of a simulation computer, a 
joystick, steering wheel and the graphical user interface (GUI). The CLS-E Brunner Jet joystick 
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model from the manufacturer Brunner AG [Bru22] was used as joystick and the Logitech G29 
Driving Force [Log22] was used as steering wheel. 


The test bench utilizes the commonly used Robot Operating System (ROS) middle-ware pro- 
viding a well organized software structure. The software and hardware components of the 
test bench are given in Figure 6.2. The models of the vehicle manipulator were implemented 
in Matlab/Simulink from which C++ ROS-Node were generated. Further details of the imple- 
mentation are given in Appendix B. The generated C++ ROS-Nodes were able to run in soft 
real time on the simulation computer (Intel(R) Core(TM) i7-5930K CPU @ 3.50GHz, operating 
system: Ubuntu 18.04. ROS-distribution: melodic). The generated ROS nodes provided updated 
signals from the simulation model with 50 Hz”. 


The GUI was implemented with the program package pygame [Shil1]. The GUI was a simple 
emulation of the complex working environment of the vehicle manipulators. No sensor models 
were implemented, because their influence was not in the focus of the experiments. Using 
a simple GUI was beneficial because the perception of the human operator was not biased 
by other factors. Therefore, the experiments were suitable to compare the control concepts 
without having biased perception of the test subjects. Furthermore, a simple representation 
helped to reduce the learning and training time in the experiments. The references and the 


Figure 6.1: Picture of the test bench showing the vehicle manipulator. The GUI on this image belongs to the second 
experiment, see Section 6.3 [VRH22]. ©2022 IEEE 


37 The choice of 50 Hz correlate with the standard update frequency of the CAN on large vehicle manipulators 


utilized in road maintenance. 
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Figure 6.2: The general software and hardware structure of the simulator enabling human-in-the-loop experiments. 
The controller, the graphical user interface and the steering wheel are marked with orange color symboliz- 
ing that these components are modified for each experiment. 


Simulation Computer 


goals during the experiments were displayed in this GUI. Additional pictograms were used to 
visualize the longitudinal motion of the vehicle manipulator. The GUI was updated with 25Hz, 
which can ensure a smooth visual motion perception of the test subject. 


The steering wheel has a standard USB-driver for reading and controlling the steering angle. It 
has a dual-motor force feedback and a helical gearing, which enables a high precision. The 
maximum control torque is limited to 2.5Nm ensuring the safety of the test persons. The 
maximal wheel rotation is +57, however, the use of +7 was sufficient for the experiments. The 
measurements of the steering angle of the steering wheel are logged with 100 Hz. The joystick 
has a CAN interface with a manufacturer specific protocol. The manufacturer did not provide 
a driver for Ubuntu systems, therefore, a new driver software had to be implemented enabling 
a ROS-connection, cf. Figure 6.2. The maximum pitch and roll angles are 20.5 deg and the peak 
torque is 4.2 Nm. The human inputs, which are the measurement signals of the two joystick 
angles, are updated with 100 Hz. 


As the three experiments have different purposes, the hardware and software setups are slightly 
different for them. The components, which are adjusted for each experiment, are marked with 
the color orange in Figure 6.2. These differences are explained in the corresponding sections 
in detail. This thesis does not focus on haptic interactions between human and automation 
through the steering wheel or joystick. However, it is possible to provide active haptic feedback 
through these devices. Such concepts to provide haptic support for the operator are investigated 
in two research works [VBSH20, VSB* 20]. For more details on these practical applications, it 
is referred to these publications. 
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6.1.2 Experimental Evaluation Measures 


Before presenting the experiment, the overall evaluation goals of the proposed LISC are dis- 
cussed. Due to the operational complexity and the lack of systematic evaluation and perfor- 
mance criteria for vehicle manipulators in road maintenance [Rec16], three general goals are 
stated in the following: 


e The first measure is task execution time and precision, which is referred to as the 
performance (of the controller). The shortage of skilled vehicle manipulator employees 
[Gmb16], [Ost20, Chapter 1] explains the importance of the reduction of the working 
time and an enhanced occupancy rate” of large vehicle manipulators. This first measure 
includes the challenge of dual trajectory tracking. It should involve objective criteria as 
well as answers whether operators of vehicle manipulators can work faster and more 
precisely with the proposed LISC. In the current quality management practice of road 
maintenance works, there is no explicit definition for the performance of the operator 
or an assistant system [Rec16]. Therefore, the performance measure has to be chosen 
for each experiment in such a way that the comparisons of the different controllers are 
possible. 


e The second measure is inspired by Csikszentmihalyi’s flow theory, see [Csi75, CL89, 
ESP21a]. Working with the vehicle manipulator can be very uneventful and monotonous, 
which can burden the operator and bring them into an undesired mental state. Using 
flow theory, the operators experience can be measured which allows for the recognition 
of such a state and more importantly, identify the effects that different control concepts 
have on the human experience. A positive subjective experience can lead to satisfaction 
among the operators and help to solve the shortage of skilled employees. 


Finally, the mental load of the operator is introduced as a third measure, based on the 
National Aeronautics and Space Administration Task Load Index (NASA TXL), see [HS88]. 
The reason for this measure is that an optimally challenged operator works more precisely 
and more efficiently while, burnout and overstressing can be avoided. In addition, an 
optimal task demand leads to less fatigue, which results in less damage to expensive 
work equipment. Therefore, it is in the interest of both employers and manufacturers to 
reduce the operator’s mental load. 


In contrary to the experiment of this chapter, in [VSSH19], a practical shared control approach 
was presented for the problem of the vehicle manipulators, which was tested with human test 
subjects in [VSB* 20]. But, these works used a heuristic tuning of the parameters based on the 
model of the vehicle manipulator. Such a manual design complicates the general applicability 
of the concept developed in [VSSH19]. Therefore, the subsequent experiments and the results 
also provide the first indication of the generality of the LISC design procedure. 


38 The occupancy rate is defined by the time in which the vehicle manipulator is in usage relative to overall working 


time, see e. g. [FP21]. 
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6.2 Comparing Full and Limited Information Controllers 


The first experiment has three goals: 


1 Experimental demonstration of the general usability of the proposed LISC design with 
test subjects in a realistic setup. 


2 Statistical analysis of the LISC concept and the state-of-the-art NCC. This comparison 
has a practical relevance: Both NCC and LISC may be implemented on a real vehicle 
manipulator with the same sensors and hardware setup, thus using LISC does not require 
further hardware equipment. 


3 Comparison and equivalence testing of LISC with FISC, as the theoretical hypothesis 
suggests that through the proposed design procedure, see Section 3.3, LISC can have an 
overall performance similar to FISC despite limited information. 


The FISC is used as a baseline and theoretical optimum”? of the problem. In this experiment, 
the desired goal is that LISC reaches an overall system performance similar to FISC. The 
experiment can provide the first indication of the practical applicability of LISC. A NCC is 
taken into consideration as a state-of-the-art solution and a comparison between LISC and 
NCC is provided. The NCC controls the vehicle without taking into consideration the tasks 
and motions of the manipulator. 


6.2.1 The Experiment Setup 


In this experiment, the steering wheel was not used by the test subjects, because a full au- 
tomation of the vehicle is assumed. See Figure 6.2, the orange-colored steering wheel was not 
controlled by the human operator. Consequently, the test subjects had no direct control over 
the vehicle motion. They solely controlled the EE of the manipulator with the joystick, which 
set the desired velocities of the manipulator in the x and the y directions. The GUI used in this 
experiment includes two predefined references for the dual task: The red and the grey paths 
were the references of the manipulator and the vehicle, respectively, see Figure 6.3. The two 
controllers, LISC and FISC were designed as given in Sections 5.2.1 and 5.2.3. The NCC was 
applied as presented in Section 5.4.2. 


For the controller design, the reference human model was assumed as given in Section 5.2.1. The 
parameters of the model were estimated beforehand based on the quantitative assessments. The 
identification of the human operator without the shared control is not reasonable as the human 
operator verifiably adapts their behavior to the shared control setup [IEFH18]. Therefore, since 
the suggested design from [Fla16, Chapter 6] with a prior identification of the human’s cost 
function is not reasonable and a nominal human model was used for these experiments. 


39 Note that in real applications, the use of the FISC is not possible, see Section 2.3.2. However, in case of full 


information about system state and references, FISC is the ideal (best) solution for the problem, which can be 
achieved. Assuming that the human is perfectly identified and the global objective function J (8) represents the 
system requirements perfectly, there is no solution which could outperform FISC. 
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6.2.2 Experiment Procedure 


Sixteen test subjects (4 female and 12 male, age 27.8 + 3.0 years) took part in the experiment. It 
was a within-subject experiment meaning that all the test subjects tested all controllers. The test 
subjects had the task of keeping the manipulator on its reference (red line) as well as possible. 
They used the joystick to control the speed of the EE of the hydraulically actuated manipulator 
relative to the vehicle. Their goal was to maintain an error as small as possible. Furthermore, 
they had to evaluate the three controllers (LISC, FISC and NCC) by answering a questionnaire. 
The test subjects were undergraduate students and research assistants at the Karlsruhe Institute 


Figure 6.3: Graphical User Interface of the scenario with the vehicle manipulator in the first experiment. The 
manipulator reference (red line) was used only by FISC and for the evaluation. LISC and NCC do not 


require the manipulator reference [VIH22]. ©2022 IEEE 
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of Technology. They had no experience with real large vehicle manipulators or with similar 
systems. None of them had participated in an experiment with the test bench. 


The controllers were tested in a random order and the test subjects were unaware of which 
controller they were testing currently. The experimental protocol began with a familiarization 
process: The test subjects had the opportunity to become familiar with the control of the ma- 
nipulator. This part took approximately 250s. The test subjects were allowed to do anything to 
learn to control the manipulator. The instructions also emphasized that the vehicle manipulator 
consisted of non-linear models. This meant that the manipulator had limitations that could 
be reached with unskilled input*’. It was also explained that the motion of the manipulator 
depends on its manipulability. The optimal position of the manipulator is also demonstrated by 
the instructor of the study. 


The test run and these instructions were followed by the actual scenario including two typical 
types of references (sudden step forms and smoother V-forms) and with the velocity of the 
vehicle set to v = 1.2 m/s, which is a common speed for roadside work with a large vehicle 
manipulator, see e.g. [Fie20, MUL20]. The independent variable was the choice of the controller 
(FISC, NC, LISC). The runs of the actual scenario took approximately 700s. Between these 
runs, the test subjects were given the possibility to take notes about the controllers. Finally, 
they had to evaluate the controllers by answering three questions, see next Section. 


6.2.3 Hypotheses and Evaluation Criteria 


This experiment investigated two hypotheses: 


H1, The use of the proposed LISC leads to a significant task performance improvement 
compared to NCC. 


H2m There is no significant task performance difference between FISC and LISC using the 
design with the NPDG. 


Hypothesis H1p; assumes that the use of a well-designed controller provides additional help 
for the human operator that leads to an increased overall task performance. This comparison 
has an important practical implication: It is possible to improve system performance without 
the need for additional sensors or a special perception system on the vehicle manipulator. Thus, 
the proposed LISC and NCC have the same hardware configuration and no sensors for the 
references of the manipulator. On the other hand, H2, has a theoretical purpose: Using the 
proposed design of LISC leads to a controller which can provide a support similar to FISC 
without the need for additional sensors or perception systems on the vehicle. 


In order to evaluate the two hypotheses, objective and subjective measures are defined for 
both. For the objective assessment, a stack consisting of Mp data points was collected from 


40 The three-dimensional configuration of the manipulator is not visible. Thus, it cannot be seen if the manipulator 


is fully stretched out and cannot be moved further. The limitation was demonstrated in the familiarization process 
by instructing the test subjects to reach this boundary point. 
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the measurements with 25 Hz. Based on these, the performance, defined as the average of the 
root-mean-square error of the manipulator 


A ee 
davgm = \| — >, d3 [k], (6.1) 
g M, 2 [k] 


is computed for each test subject. The motivation of (6.1) is that the mutual effort of the test 
subjects and the automation is a precise tracking of the reference of the manipulator. The 
subjective evaluation of the controllers happens by means of three questions using an 11-point 
Likert scale ([Lik32] or [Alb18, Chapter 2.]): 


Q1 How do you assess your task performance? 
(Insufficient 0 - 10 very good) 


Q2 How intuitive did you find the support? 
(Not intuitive 0 - 10 very intuitive) 


Q3 How useful was the support to better accomplish the task? 
(Very disturbing 0 - 10 very helpful) 


The first question about the assessment of the mental load of the operators is inspired by the 
NASA-TLX questionnaires, see [HS88]. The second and the third questions have practical 
inspirations: The second question measures how intuitively the operator could use the system. 
An intuitively supporting controller is important to enhance the acceptance and reduce the 
training phase with the assistance system. The third question is the subjective perception of the 
test subjects about how they performed the task. It measures the self-confidence of the operator 
with the system. The more self-confidence the operator has, the higher the satisfaction of the 
operator is. 


Note that the comparisons are not classical pairwise ones: H1g; is a difference test between 
LISC and NCC, while, H2g; is an equivalence test, which requires other test methods than the 
hypothesis tests for difference [CGA04] and [MC12]. More details on equivalence testing are 
given in Appendix D.1. 


6.2.4 Results and Discussion 


From each test subjects two runs are obtained which are used for the analysis of H1g1 and H2rı. 
For the testing of H1p; and H2f1, the significance level is uniformly chosen to agxp,ı = 0.05. 
For more details, it is referred to Appendix D.3. 


Objective Results 


The means and the standard deviations of the average errors of the manipulator davg,m are 
shown in Table 6.1. It can be seen that NCC has the largest average error resulting in the 
weakest performance. Then, the measurements of (6.1) are tested with Shapiro-Wilk test for 
the normality condition, see [SW65]. This shows that measurement sets of the three different 
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controllers are not normally distributed, see the results in Appendix D.3. Therefore, the Wilcoxon 
Signed-rank test is used to statistically compare NCC and LISC, see e. g. [Dal08, Chapter 4.] or 
[Bra14]. An additional Bonferroni correction is applied, therefore, the corrected significance 
level of Hirı is &exp,ı = zZ = 0.025. The Bonferroni correction is necessary because the 
same data is used for the analysis of H2rı. The p-value obtained the Wilcoxon Signed-rank 


test 


Puiscncc = 1.9- 10°°, 


which is &gxp,ı > Puisc-ncc- Thus, the proposed LISC is significantly better than NCC, and 
Hlpı is accepted. 


The testing of H2z is conducted by two one-sided sign tests (TOST) with a 90 % confidence 
interval for the difference. The equivalence margin was chosen to +0.05. In the case of statistical 
equivalence, the mean of the difference variable Adayg m = dLISC,avg,m — dFISC,avg,m is in the 
equivalence margin. The TOST provides two p-values for both sides: If both values are less 
than the significance level agxp,ı, the two measurements are statistical equivalent and there is 
no statistical difference between the median values of FISC and LISC. The p-values obtained 
are 


prisc-usc = [0.006, 3.1- 1074]. 


Because Qpxp,1 > Prisc-usc holds, H2,) is also accepted. Further details to the obejctive results 
of the first experiment are given in Appendix D.3 


Table 6.1: The means and corresponding standard deviations of the average errors of the manipulator davg,m 


NCC FISC LISC 


dagminm | 0.51 0.33 0.35 
SD4 inm | 0.27 0.23 0.22 


avg,m 


Subjective Results 


The results of the questionnaire are given in Table 6.2. They reinforce the results of the 
quantitative results. Table 6.2 shows the means of the assessments for the corresponding 
questions and controllers. It can be seen that LISC has better results in all three questions than 
NCC. The FISC has the highest scores in all three questions. Since, the answers are given in a 
11-points scale, Wilcoxon Signed-rank test is applied". 


Table 6.2: Mean values and the standard deviations of the personal questionnaire results 


NCC FISC LISC 
Q1 - Self-assessment 4.9442.21 7.5041.10 6.75+1.39 
Q2 - Intuition 4.00+2.10 7.81+1.42 7.2141.37 
Q3 - Support helpfulness | 3.50 +2.28 7.8141.47 7.00+1.41 


41 The measurement data is classified into categories with a rank order (0,1,....9,10). Such data is called ordinal, for 


which non-parametric statistical tests need to be used. For more detail, see Appendix D.2 or [Nor10]. 
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Testing H1, includes the comparison of the results from LISC and NCC. The p-values obtained 
from the one-sided Wilcoxon Signed-rank test are 


1 
Pa = 0.012, 

2 -4 
Decke =1.8-10™, 

3 -4 
Ponce =6.7+10™, 


which are less than &rxp,ı showing that LISC is significantly better than NCC. The proposed 
novel shared controller with the systematic design leads to a better subjective assessment of 
the task performance. Furthermore, it is rated to be more intuitive and more useful compared 
to NCC. 


To test H2¢g1, three TOSTs are carried out, for which the equivalence margin was set to +2 
steps of the answer scale. This choice was supported by the observation that the test subjects 
were not able to clearly distinguish a step less than 1.5 — 2 points. The resulting p-value pairs 
of the TOSTs are 


Í -4 
Ps = [0.019, 1.2- 1074] 
Pr dae = [0.004, 7.0- 1074] 
Dee [0.026, 1.8- 1074]. 
For the first and second questions, @pxp,1 > max Ve holds, meaning that there is no 


significant difference between FISC and LISC. On the other hand, the test subjects did not find 
the support of LISC and FISC similar because Qpxp,1 < max I et holds. The results of 


10+ 10+ 10+ 
8 8H 8 
6 6+ 6 
(0) 
4 AE 4 
(0) 
2 2, 2 
f ı 0 f ı 0 f ı 
NCC FISC LISC NCC FISC LISC NCC FISC LISC 
(a) Results of the first question (b) Results of the second question (c) Results of the third question 


Figure 6.4: The box plots show the subjective results of the three lateral controller: NCC, FISC and LISC. The red 
circle is the mean value of the results. 
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the subjective assessments of the controllers are illustrated with box plot in Figure 6.4, where 
the inferiority of NCC compared to LISC and FISC is clearly 


The verbal feedback of the test subjects enhance these results: The difference between FISC and 
LISC was not noticeable for the test subjects. The third test subject expressed his personal point 
of view by saying "Controller 1 [LISC] is more aggressively configured than controller 2 [FISC]" 
and test subject 11 said: "Controller 3 [FISC] helps more in small curves than controller 1 
[LISC], but not in large curves". On the other hand, all the test subjects were able to distinguish 
NCC from FISC and LISC. The analysis of the subjective assessment underpins the acceptance 
ofHirı and H2pı. 


Discussion 


The resulting trajectories of the different concepts of an exemplary test subject are presented 
in the following figures. Figure 6.5 shows a scenario with smooth V-formed references, in 
which the trajectories are compared, obtained from test subject number 6 using NCC and LISC. 
It can be seen that with LISC, a better tracking of the manipulator references is possible. At 
x x» 30m, the vehicle with LISC does not follow its reference as precisely as NCC does. This 
way, LISC helps the operator to reach the reference of the manipulator and only afterwards 
returns to the vehicle reference. The human operator can track the reference more efficiently. A 
similar motion of the vehicle can be observed at x ~ 100m, where the vehicle with LISC leaves 
its reference to help the operator to follow the reference of the manipulator more accurately. 
Furthermore, the changes in the reference of the vehicle are not followed as accurately by LISC 
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Figure 6.5: Illustrative comparison of the overall performance (test subject 6) to track the references (thick lines) of 
vehicle and manipulator using a controller with no cooperative support (thin line) and a LISC (dashed) 
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as by NCC, see x x 55 and x = 82.5 m. This is a compromise: Tracking both references is not 
possible, so a decision has to be made about which one has a higher priority. As the tracking 
manipulator’s reference is defined as the mutual effort ofthe shared control setup, it is more 
important. Thus, the vehicle leaves its own reference and supports the human operator. 


It is important to note that one possible way to handle such a challenging situation would 
be to slow down the vehicle, carry out the challenging maneuver with the manipulator and 
then accelerate the vehicle to the reference speed. It is possible to follow the references of the 
vehicle manipulator at lower speeds. However, this solution would increase the working time 
and worsen the occupancy rate ofthe vehicle manipulator. Thus, using LISC facilitates the 
same quality ofthe work in shorter time. 


Figure 6.6 comprises the resulting trajectories of FISC and LISC from test subject 12, where 
the references have sudden steps. The supporting motions of FISC and LISC are apparent: The 
vehicle leaves its reference (see x x 27m, x x 75m and x ~ 100m) to help the operator to 
follow the reference of the manipulator. The assistive behavior of the automation by sharing 
the effort to reach the reference of the manipulator can be seen in the case of both controllers, 
the trajectories are similar despite the limited information. 


In the first subfigure of Figure 6.7, the references of the vehicle and the manipulator are given 
explaining the changes in the two other subfigures more clearly. Then, the inputs of test 
subject number 12 controlling the manipulator (second subfigure) and the corresponding lateral 
deviation from the reference (third subfigure) are compared. At x x 27m and x » 38m, the 
reference of the manipulator has sudden steps, which have to be followed by the manipulator. 
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Figure 6.6: Comparison of the overall performance (test subject 12) to track the references (thick lines) of vehicle and 
manipulator using a controller with FISC (thin line) and LISC (dashed) 
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To compensate this, NCC needs the most time, while, both FISC and LISC can reduce the 
deviation faster. 


There are minor differences between the resulting trajectories of LISC and FISC, in contrast 
to the simulations with the design models, see Chapter 5, where the trajectories are closer 
to each other. The reason for these differences is that a simulated human model generates 
the inputs in the simulations in Section 5.2 and 5.3, in contrast to this first experiment where 
human test subjects controlled the manipulator. The behavior of the test subject varied in 
different situations during the experiment. This indicates that the resulting trajectories of such 
an interaction depend on both the shared control and the human qualities (human objective 
function). Thus, further research is desirable to answer the question as to how the adaptation 
of shared control on human variation can be managed from both a practical and a theoretical 
perspective. 


Still, even in this current setup, the benefit of the novel, LISC is clear from Figure 6.6: Despite 
the limited information about the references LISC can provide a similar support, which does 
not differ strongly from a FISC. 
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Figure 6.7: Comparison of the input signals from the human-controlled joystick using the three controllers (LISC, 
FISC and CNN) The measurements are taken from test subject 12. The upper subplot shows the reference 
trajectories of the vehicle and the manipulator. The middle subplot presents the normalized inputs of the 
joystick while in the lower figure, the deviations of the manipulator in m are presented. 
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6.3 Lateral Experiment without References 


This experiment had the goal to compare LISC with fully manual control, which is the current 
state of the art for large vehicle manipulators. The contents of this section are presented in 
publication [VRH22]. 


6.3.1 The Scenario and the Controllers 


The main difference from the first experiment is that no reference path was explicitly given: 
The goals of the test subjects were changed from following a reference path to collecting boxes, 
cf. Section 6.2. The task of the test subjects was to collect blue‘? boxes. The setup is used such 
as given in Figure 6.1 showing the screenshot of the GUI modified for this experiment. The 
vehicle reference trajectory was given because it is necessary for the automation of the vehicle. 
In addition, NCC was also included in the experiment, enabling further comparisons. 


In this experiment, both controllers LISC and NCC, had the same design procedure as given in 
Section 5.2.3 and Section 5.4.2. The usage of these two controllers is explained by the fact that 
neither of them require the reference or the system states of the manipulator. Therefore, they 
could be used straightforwardly. If the lateral controllers were active, the test subjects only had 
to control the manipulator and the vehicle guidance was autonomous. While, in the case of 
manual control (MC), the test subjects had to control both the vehicle with the steering wheel 
and operate the manipulator with the joystick. 


The vehicle traveled at a constant speed. The reference path of the vehicle had only minor 
variation because of the real-world applicability: Motorways have smooth curvatures and no 
sudden variations. The boxes were placed in such a way that, in specific situations, it was 
necessary for the vehicle to cooperate with the manipulator in order to reach the boxes. These 
were situations in which the test subjects had to prioritize whether to stay on the reference 
with the vehicle or collect the blue box with the manipulator. 


6.3.2 Procedure and Hypotheses of the Experiment 


Fourteen test subjects (2 female and 12 male, age 27.6 + 3.1 years) conducted this experiment. 
The test subjects had the task to collect as many blue boxes as possible and keeping the vehicle 
on its reference as well as they could. Furthermore, the same additional instructions were given 
as in the first experiment, see Section 6.2.2. 


During the automated modes (LISC, NCC) they were not allowed to touch the steering wheel. 
It was necessary for safety reasons: The setup with the steering wheel did not include any 
interaction behavior, so sudden and unexpected movements could have led to physical injuries. 
In MC, they were responsible for both the manipulator control as well as the vehicle control 
using the steering wheel. In those cases where the boxes were not easy to reach, the test subjects 
were told to leave the reference with the vehicle to reach the boxes. This coordination between 
the vehicle and manipulator was explicitly instructed. They were also told that they were only 
allowed to leave the reference to collect the box and had to return to the vehicle’s reference as 


42 Choosing the color blue had practical reasons: It ensures good visibility, whereby a variation due to the different 


perception of the test subject can be minimized. 
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quick as possible. Finally, they were informed that they needed to fill out a questionnaire to 
evaluate and compare the controllers after the study. 


After these instructions, there was an approximately 300 s long familiarization run with MC. 
This familiarization run attempted to imitate that the test subjects had relevant experience and 
could perform the task wellt’. The familiarization part is not included in the evaluation. 


Then, the test subjects performed the three experimental runs, each with one of the three modes, 
the two controllers and MC. They did not get any information which of the two controllers 
(either LISC or NCC) were active. The order of the experimental runs was randomized for each 
test subject. There was an intermediate questionnaire after each run, which was used to enhance 
the test subjects’ awareness and reflection on the different controller concepts. The results of 
this intermediate questionnaire were not used for the final evaluation. After completing the 
three experimental runs they were asked to answer the evaluation questions, which were then 
used for the subjective evaluation of the controllers. 


The central question of this experiment was whether LISC can provide an improvement of 
the measures compared to MC. Furthermore, the issue whether the proposed LISC is less 
demanding for the operator compared to MC or NCC was addressed. A direct comparison 
between NCC and LISC was not the primary goal, as that was the subject of the first experiment, 
see Section 6.2. Nevertheless, the absence of the reference can highly influence the experience 
of the test subjects. Therefore, the subjective assessments were compared between all three 
setups. For these goals, two hypotheses and two measures were defined. These hypotheses to 
be analyzed are: 


H1g2 LISC leads to significantly better performance compared to MC. 


H2ga LISC provides a more intuitive control, eases the operator's workload and improves the 
sense of control over the task compared to NCC or to the MC. 


As an objective measure of the operator’s performance the number of collected boxes was 
chosen. Additionally, the root-mean-square error of the average deviation from vehicle’s 
reference 


davg,veh m (6.2) 


was used for the evaluation. The subjective evaluation of the controllers was performed by the 
evaluation questions using using an 7-point Likert scale 


Q1 Ifound the way of working with the controller ... 
Not intuitive at all - 1 — Very intuitive - 7 


Q2 Ifelt optimally (mentally) challenged. 
(mental/cognitive strain). 
Not appropriate at all - 1 — Very appropriate - 7 


Q3 Ihad the feeling that I was in control of the process. 
Not applicable at all- 1 — Very applicable - 7 


43 This procedure was necessary because the test subjects were not professionals: They did not have any previous 


experience with similar systems or with the simulator. 
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6.3.3 Results and Discussion 
Objective Results 


In Table 6.3, the means and the standard deviations of numbers of collected boxes (Box Score - 
BS) with the three controllers are given. Beside these, the vehicle’s average deviations from 
its reference (davgveh) can be found in Table 6.3. The Figure 6.8a graphically illustrates the 
distribution of the collected boxes. From that, it is noticeable that most of the test subjects 
collected the most boxes with LISC, and a few of them achieved the same results with MC. 
Nevertheless, the standard deviations with LISC are smaller than with MC, indicating that the 
performance is well-balanced regardless the skills of the test subjects. Additionally, the box 
plots of the average deviations from vehicle’s reference (6.2) are given in Figure 6.8b, which 
shows that all the test subjects have a smaller average deviation with LISC compared to MC. 
This means that collecting more boxes did not influence negatively the tracking of the vehicle’s 
reference. 


In order to statistically test the two hypotheses, Shapiro-Wilk tests were conducted verifying 
the normality condition of the measurements. This showed that not all measurements have a 
normal distribution, see Appendix D.4. Therefore, for the test of H1g2, a Wilcoxon Signed-rank 
test was applied. The significance level is chosen to agxp,2 = 0.01 


Applying the Wilcoxon Signed-rank test shows that these differences (BS and davg,ven) are 
statistically significant. The p-values are 


pps = 3.88- 107^ and pa = 7.47:10°%, 


avg,veh 


which are both less than agxp,2. Thus, H1p2 is accepted, meaning that LISC provides statistically 
significantly better performance in terms of number of boxes collected and average lateral 
error compared to MC. Furthermore, the result from the first experiment (see Section 6.2) could 
be additionally confirmed here: Using NCC, the test subjects collected less boxes compared to 
LISC. Applying, Wilcoxon Signed-rank test on the LISC-NCC comparison, the resulting p-value 
is 


pps = 7.193-10°°, 


for which pps < OExp,2 holds, confirming the results of the first experiment that this difference 
is significant. 


Table 6.3: The mean values and the standard deviations of the collected box numbers with the two controllers and 
with the manual mode. 


LISC NCC MC 


BS [-] 114.64 79.43 98.50 
Sgs [-] 2.44 5.26 14.79 


daveveh inm 0.223 0.066 0.457 
SD- inm 0015 00 0.144 


davg,veh 
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this results also impairs collecting the boxes. 


Figure 6.8: Box plots of the second experiment, where the mean values of the results are symbolized by the circles. 


Table 6.4: The mean values (and standard deviations) of personal questionnaire. 


LISC NCC MC 


Q1 6.2140.70 2.79 +1.05 3.43 +1.83 
Q2 5.71 41.20 3.64 +1.78 3.50 +1.87 
03 6.07 +0.83 3.43 +1.87 4.36 +2.34 


Subjective Assessment 


The subjective evaluations ofthe controlmodes are given in Table 6.4. LISC yielded better results 
compared to NCC and MC in all three questions. The standard deviations of the results are the 
smallest for LISC. For the statistical test of H2xa, three samples were compared. Therefore, the 
Kruskal-Wallis test was chosen for the analysis, see e.g. [Dal08, Chapter 6.]. The degrees of 
freedom of this test were df = 2. Its null hypothesis is that there is no difference between the 
three controllers. This hypothesis is declined if H > XI am holds, where 


Adf-2,0=0.01 =9.21. 


The null hypothesis of the test is declined regarding the intuition (HS1 = 23.53), the mental 
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strain of the test subjects (HÌ? = 11.95) and also the sense of control (HS3 = 9.92). Since 
HS! > Xi, ann. YÍ = 1, 2, 3, LISC provides significantly better results in all three aspects and 
H2çgv is confirmed. 


Discussion 


This experiment raises interesting aspects that are discussed in this subsection. The solid 
evidence that LISC yielded better results than MC is promising for practical applications: It 
can ease the workload enabling the operators to concentrate better and fulfill their task more 
efficiently compared to the current state of the art. A further interesting observation was that 
the test subjects collected fewer boxes with NCC than with the MC, while their subjective 
evaluation showed no significant difference between NCC and MC, see Table 6.3 and Table 6.4. 
These results indicate that a simple, "classical" automation of the vehicle does not enhance the 
performance of the overall system with one operator. Thus, the use of NCC is therefore not 
advisable for the application of vehicle manipulators. 


Figure 6.9 compares the trajectories generated with LISC to the trajectories of MC. It can be seen 
that the test subject followed the vehicle’s reference with MC less successfully. Furthermore, 
some boxes were missed with MC, meanwhile more the boxes are collected with LISC. Similar 
results can be observed by other test subjects, for additional figures see Appendix D.4. 


A further interesting finding is that the trajectories of the vehicle are similar for both LISC 
and MC, even though that the proposed LISC does not aim to imitate the same trajectories of 
MC, using the exemplary set of trajectories from test subject number 5. The goal instead is to 
relieve the human operator in challenging situations by additional movements of the vehicle. 
How these movements are achieved is not exactly specified, e. g. there is no learning from the 


Reference Vehicle —MC Manipulator — LISC Manipulator = Boxes missed with MC 
—MC Vehicle = LISC Vehicle a Boxes to reach a Boxes missed with LISC 
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Figure 6.9: Trajectories of test subject number 5 with MC and with the proposed LISC. 
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human-driven trajectories of the vehicle to imitate the inputs of the operator has been applied. 
Still, the resulting trajectories are similar, cf. Figure 6.9. These similarities indicate that LISC 
is potentially intuitive to the human operator, which is reached by the proposed systematic 
design. A limitation of this study is that the effects of the operators’ environment perception 
are different in real application, which can influence the controller’s performance. 


Nonetheless, this simulator experiment demonstrate the usability of LISC concept and provides 
strong indications that LISC can be considered in practical future projects for manufactures of 
large vehicle manipulators. 


6.3.4 Perspectives of the real-world Applicability 


Thanks to the Autobahn GmbH, five professional operators visited the cooperative lab at the 
Institute of Control Systems and conducted the experiment during the course of this thesis. All 
professional operators work in Baden Würtemberg in the roadside maintenance divisions of 
the Autobahn GmbH. Figure 6.10 depicts the professional test subject number 2 carrying out 
the experiment. 


They work with such systems every day and use special equipment for verge mowing, ditching 
or verge cleaning. They are familiar with the challenging circumstances that arise during these 
works. During the discussions after the experiment, three of them said that they also have 
experience with agricultural machines, which often inhibit a similar setup and their operation 
includes similar challenging situations, too. Therefore, these invited professionals were capable 
of assessing LISC and providing recommendations for further development work in order to 
reach a real-world use in different applications. 


The feedback of the professional operator to the GUI confirmed its suitability for testing 
the proposed LISC. In general, the simple representation of the simulator does not impair 
the recognition and the imitation of the challenging situations of the real world. However, 
according to their feedback, the simulator is not suitable for the training of novice operators. 


The professional operators found that the experiment includes realistic situations. The resulting 
trajectories professional test subject number 2 using the different concepts are presented in 
Figure 6.11. However, in the reality, such challenging situations included in the experiment 
occur less often. Their core assessment to the assistant system was positive: They stated that 
the use of such an assistant system could help them in their work. They pointed out three main 
limitations, which should be addressed: First, they were not allowed to hold the steering wheel 
and override the inputs of the automation. The professionals explained that oversteering is 
essential to make small corrections. Secondly, they found the constant longitudinal speed of 
the vehicle inconvenient’. Thirdly, the movements of the vehicle needs to be limited: Sudden 
maneuvers with the manipulator should not imply always a sudden support from the vehicle, 
which needs to be taken into account for a real-world realization. 


44 For safety reasons, the possibilities of oversteering and speed adjustment are inevitable in a real world application 


of the LISC. This restriction was justified by the minimization of the variance in the experimental setup. Obviously, 
a real-world implementation has to exclude this restriction ensuring the safety of the other road users. 
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Figure 6.10: Test subject number 2 carrying out the experiment. 


Reference Vehicle —MC Manipulator — LISC Manipulator = Boxes missed with MC 
—MOC Vehicle = LISC Vehicle = Boxes to reach = Boxes missed with LISC 
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Figure 6.11: Exemplary trajectories of professional test subject number 2 with MC and with the proposed LISC. 
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The overall feedback of the professional operators was that the system could be useful in 
numerous scenarios, but a key remaining question is, where exactly such an automation will 
be used: There are different challenges on the motorways compared to other types of roads. 
The different road types (highway, freeway, common road etc.) have different crash-guard 
systems (e. g. "Super-Rail" or just reflector posts), which makes the work with the manipulator 
diverse. Consequently, the adaptation of LISC for each scenario is necessary. The acceptable 
maximal lateral motion of the vehicle is depend on the road type as well. Furthermore, they 
mentioned that the preferences of the operators may vary depending on their mental state, 
road or lighting conditions. Due to the systematic design, such requirements can be formulated 
in the global objective function, which automatically provides the parameters of LISC. Different 
preferences of the human operator can be handled by identifying operator possibly, which can 
lead to broader acceptance. Summarizing the visit of the professionals, the general applicability 
of LISC is demonstrated. The feedbacks facilitate further progress towards an actual realization 
of the proposed LISC. 
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6.4 Experiments of the Longitudinal Shared Control 


The third experiment took an agricultural application into account. In the experiment, a 
harvester (1) and a bankout wagon (2) are to move in a coordinated manner, see Figure 6.12. 
The bankout wagon gathers the grains and travels at a constant speed. On the harvester, an 
operator controls the unloading tube to transport the corn from the harvester to the bankout 
wagon. It is assumed that the bankout wagon is automated. To enable the optimal distribution of 
the harvested grain in the bankout wagon, the manipulator of the harvester must be positioned 
accordingly. 


The goal of the experiment is to study the applicability of LISC for the longitudinal guidance 
of the large vehicle manipulator: The longitudinal speed of the harvester is adapted by LISC 
according to the task with the human-controlled manipulator. This way, the work time can be 
reduced. The longitudinal LISC requires the longitudinal model as presented in Section 5.1. The 
main question of this experiment is whether the proposed longitudinal LISC has advantages 
or disadvantages compared to NCC. The NCC is taken into account as currently used state- 
of-the-art technology because its realization is straightforward. Therefore, a comparison 
between the NCC and the LISC is given and no manual control is taken into account. Parts of 
this section were published in the research article [VH22]. 


Figure 6.12: Agricultural application to demonstrate LISC for the longitudinal shared control of a large vehicle 
manipulator. The application includes a harvester (1) and a bankout wagon (2) [Mov22, VH22] 


‘48 The actual state-of-the-art large vehicle manipulators have also been using a low-level (so-called hydrostatic drive) 


longitudinal cruise control. 
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6.4.1 The Setup and the Controllers 


The GUI of the simulator was modified for this experiment and the focus was the analysis of 
different longitudinal controllers. The harvester traveled at constant velocity along a reference 
path having only small lateral variations. The lateral controller was a non-cooperative one: The 
actions of the human operator did not influence the lateral motion of the vehicle, in contrast to 
the earlier experiments. The lateral controller only compensated for the lateral error of the 
vehicle, which was caused by the reaction forces and torques of the outstretched manipulator 
on the vehicle. 


The longitudinal controllers (LISC and NCC) were implemented as given in Section 5.3. Both 
controllers provided the guidance speed of the vehicle, and the required driving torques of the 
wheels were set by a low-level PI controller. At this low level, there is no difference between 
LISC and NCC. For more details on the low-level controller, it is referred to Appendix B.2. 


The longitudinal experiments required an adjusted task: It consisted of five red boxes which 
had to be reached one after the other by the manipulator. These five boxes symbolized five 
sections within the bankout wagon, which had to be filled up. The filling process was imitated 
by remaining on the red boxes for 2.5s. After hovering over the boxes, they became green, 
meaning that this part of the bankout wagon was full, and the operator had to move the 
manipulator otherwise the distribution of harvested grain would not be optimal. The five 
boxes disappeared when all of them had been reached simulating that the unloading was ready. 
Afterwards, five new boxes appeared immediately at a different position, which also had to be 
filled. It was important that the boxes were not allowed to be "left out". Test subjects breaking 
this rule more than 5 times were excluded from the experiment. In a real application, this 
would have meant that the bankout wagon was not filled optimally. 


After filling the bankout wagon four times, the simulation stopped, and the next run with the 
other controller could be started by the test subject. At the top of the GUI, the test subjects 
were able to see which controller was active, cf. Aut1 and Aut2 in Figure 6.13. However, they 
did not have a mapping from Aut1 and Aut2 to LISC and NCC. Thus, they did not know which 
controller they tested. The running order of the controllers was fixed: Test subjects with even 
session numbers carried out NCC at first, and then LISC. Meanwhile, test subjects with uneven 
identification numbers started with LISC and finished with NCC. 


6.4.2 Experiment Procedure 


Seventeen test subjects (3 female, 14 male, average age of 28.2 + 2.7 years) took part in the 
experiment. They were given the goal to finish the overall task as fast as they could. The 
experiment consisted of the following parts: 


« Familiarization with the system and the control of the manipulator. 
e Arun with each NCC and LISC followed by intermediate questions. 
e Arun with each NCC and LISC without intermediate questions. 


« Answering the evaluation questions. 
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Figure 6.13: The image of the GUI used for the longitudinal experiment. Two boxes are already filled up and the 
operator moves the manipulator to the next box. 


The familiarization part and the intermediate questions were not used for the latter assessment 
of the experiment. Their purpose was to help the test subject to be able to evaluate the 
controllers. The experiment materials including the questions and the instruction are given in 
Appendix D.5. 


6.4.3 Measures of the Experiment 


The aim of the experiment is to show that the use of LISC also has advantages for the longitudinal 
guidance of the vehicle manipulator. On the one hand, the adaptive motion of the vehicle can 
help the operator to reduce the task execution time. On the other hand, the interacting behavior 
can also lead to additional stress and be less intuitive“. 


Two hypotheses are formulated for the evaluation: 
H1p3 Using LISC significantly reduces the working time compared to NCC. 


H2x3 The operator does not have an increased mental load or a less intuitive operation of the 
vehicle manipulator using LISC compared to NCC. Furthermore, LISC is not less helpful 
than NCC. 


For the evaluation of H1p3, the overall time to, is taken into account, which describes the 
necessary time to finish the task. 


6 For a better understanding, the reader may think of adaptive cruise control by passenger cars, whereby the desired 


distances cannot be set intuitively. Thus, the system can easily lead to frustration and the driver does not want to 
use the assistant system. 
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The extended input of LISC is the jerk of the vehicle ov , which can possibly lead to more 
sudden motions of the vehicle. Furthermore, the input of the operator is used by the LISC to 
adapt the speed of the vehicle. This combination can lead to an increased sensitivity to the 
inputs of the operator. Such sensitivity possibly increases the mental load of the operator. The 
main question of H2g3 is whether a systematic controller design of LISC can evade such a raise 
of the mental load. To assess H2p3, the test subjects answered the following final questions on 


a seven-point Likert scale: 


Q1 I found the way of working with the automation concept ... 
(1-Not intuitive at all - 7-Very intuitive) 


Q2 How helpful were the automation concepts in completing the tasks faster? 
(1-Not helpful at all - 7-Very helpful) 


Q3 I felt optimally (mentally) challenged. (mental / cognitive workload). 
(1-Not at all applicable - 7-Very applicable). 


6.4.4 Results and Discussion 


Two of the test subjects had to be excluded: One test subject did not follow the instructions 
precisely and had left out the green boxes 7 times. For another test subject, the data logging 
failed due to an unexpected stopping of Ubuntu services on the simulator computer. Therefore, 
their objective and subjective results are not used in the assessment of the controllers. The data 
from the fifteen remaining test subjects are used for the evaluation. The significance level for 
the third experiment is chosen to &gxp,3 = 0.05. 


Objective Results 


The performance measure of the experiment is the overall time to finish the task. The means 
and the standard deviations of the resulting overall times using LISC and NCC are given in 
Table 6.5, which shows that using LISC reduced the necessary time compared to NCC. To 
choose a suitable statistical test for H1g3, Shapiro-Wilk test and F-test were conducted. They 
showed that not both data sets have a normal distribution, see Appendix D.5. Therefore, the 
Wilcoxon Signed-rank test is applied. The p-value of the Wilcoxon Signed-rank test is 


pm = 2.13-10°°, 


which is less than the significance level apxp,3 meaning that the test subjects carried out the 
task with LISC significantly faster than with NCC. For a visual representation of the results, the 
histograms of the two controllers are given in Figure 6.14, which reinforces the conclusion that 
the test subjects were able to perform the task faster using LISC. Therefore, H1g3 is accepted. 
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Table 6.5: Mean values (standard deviations) of the overall times for completing the task. 


NCC LISC 


foa | 204.98 174.28 
SD | 12.48 11.48 


Subjective Results 


The questions for a subjective assessment of the controllers have the following goals: 


e With the first question, the ease of use is evaluated. NCC is presumably easier to use 
because there is no additional motion of the vehicle. 


« The second question is to assess if the test subjects notice the time saved with LISC. 


e Finally, the third question focuses on the mental state of the test subjects, which is a 
trait for the so-called flow state, see [Csi75]. It can be examined if the test subjects are 
over-strained or bored. 


The mean values and the standard deviations of the answers are given in Table 6.6. It can be 
seen that LISC leads to better average results. For a more illustrative representation of the 
results, the box plots of the subjective results are given in Figure 6.15. 


To evaluate H2p3, a non-inferiority statistical test needs to be applied, which can answer the 
question whether a novel method is not worse compared to standard methods. For that, a 
one-sided sign test is used for evaluating the non-inferiority of LISC. The inferiority bound 
was chosen to 1.5, which was due to the fact that the test subjects were able to distinguish 
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Figure 6.14: The box plot of the finishing times of the task with NCC and with LISC. Most of the test subjects were 
able to finish the task in less time with LISC than with NCC. 
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Table 6.6: Mean values with the corresponding standard deviations of the personal questionnaire 


NCC LISC 
Q1 - Intuition 6.00+1.25 6.47 0.83 
Q2 - Helpfulness 4.47 +1.77 5.93 1.22 
Q3 - Workload optimality | 4.33 + 1.45 4.73 1.33 


approximately two steps in the Likert scale. For more details on non-inferiority statistical tests, 
see [Lak17] or Appendix D.1. The obtained p-values are: 


PNE = 0.012, 

a = 6.8-10°%, 

Piise.ncc =6.7.10%, 
which are all less than agxp,3. Thus, the results indicate that the test subjects did not perceive 
inferiority in all three aspects between LISC and NCC. This means that the test subjects did 


not find NCC better compared to LISC. Thus, the results indicate the non-inferiority of LISC 
and H2p3 is accepted. 
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Figure 6.15: The box plots show the subjective results of the two longitudinal controllers, LISC and NCC. The red 
circle is the mean value of the results. 
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Discussion 


The results show that the test subjects were able to complete the same task faster without 
increasing their mental load. For further discussion, the following two figures show the relative 
longitudinal distance and velocity of the manipulator, respectively. 


Figure 6.16 shows an exemplary set of trajectories from test subject number 4, in which 
the test subject needs to extend the manipulator less with LISC than with NCC. An optimal 
configuration of the vehicle and the manipulator includes a lateral distance of approximately 
4 meters between them. This allows a good manipulability of the manipulator. The spans 
between the maximums and minimums of the relative distance are smaller for LISC than for 
NCC. Thus, the operator can react to changes of the goals faster, which can be seen in Figure 
6.17 after t » 25s: Using LISC, the test subject could start the new maneuver at t x 25s. On the 
contrary, the new maneuver started t 30s using NCC. This observation also supports the 
quantitative results that LISC increases the efficiency of the task execution. 


The task used in the experiment is designed to keep the workload with NCC low. The study 
aims to determine whether the use of LISC results in a higher mental load and less intuitive 
usability’. Analyzing the questionnaire, no significant changes in the workload can be reported, 
while the task execution time was reduced. How disruptive LISC can be in real applications is 
still an open question. Since the study only took around 30 minutes and did not last for days, 
the long-term adaptation of the test subjects could not be observed. However, this adaptation is 
also an essential factor for the acceptance of LISC. The results were achieved using a simulator 
and the subjects perceived the accelerations and velocities only visually, which may also have 
had a further impact. 


Still, the results of the study show that LISC was applied effectively and provides the first promis- 
ing indications that a cooperative longitudinal control of large vehicle manipulators is beneficial. 
Therefore, LISC can be considered as a promising solution for real-world implementations. 
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Figure 6.16: The relative position of the manipulator with LISC (blue solid line) and with NCC (red dashed line) 
originated from the 4th test subject 


47 Increased task complexity is caused by the additional motion of the vehicle through the use of LISC. Using NCC, 


this additional motion of the vehicle is not present. 
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Figure 6.17: The relative longitudinal velocity of the manipulator with LISC (blue solid line) and with NCC (red dashed 
line) originated from the 4th test subject 
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6.5 Discussion and Summary of the Chapter 


First, this chapter presents the test bench including the simulation models of the vehicle 
manipulator and the further hardware- and software-components. That is followed by three 
experiments, which demonstrate the usability and benefits of the proposed LISC by comparing 
it with state-of-the-art controllers. The results from all three experiments provide promising 
indications that the designed LISC outperforms the state-of-the-art technical solutions and 
other control concepts. Thus, the experiments with LISC is accomplished and the third research 
question is answered. 


In the first experiment, LISC was compared to FISC and to an NCC. The results show that 
LISC and FISC are statistically equivalent from both objective and subjective points of view. 
The test subjects were not able to distinguish between these two shared control concepts. In 
addition, NCC had a significantly inferior performance compared to LISC and FISC. These 
results indicate that a controller, which actively supports the human operator in their task, 
would be beneficial in real-world applications. 


The second experiment included a comparison of manual control with both the proposed LISC 
as well as with NCC. The main finding of this experiment is that LISC outperforms manual 
control significantly with respect to the experiment measures. A further noteworthy result 
is that manual control surpasses NCC. This is promising evidence that the automation of a 
large vehicle manipulator requires the coordination between the automated vehicle and the 
human-driven manipulator, which can enhance the acceptance of the automation of such 
systems. 


In contrast to the first two experiments, which addressed the lateral shared control, in the 
third experiment, LISC was applied to the longitudinal control of a large vehicle manipulator. 
The results showed that using LISC could shorten the working time with the large vehicle 
manipulator compared to the current state-of-the-art technical solutions. This was possible 
through the adaptation of the speed of the vehicle, which however increased the complexity of 
the task for the operator. Therefore, the experiment also analyzed whether the complexity of 
LISC leads to an inferior subjective assessment compared to NCC. The results indicate that the 
test subject were able to carry out the experiment significantly faster without perceiving an 
inferiority of the proposed LISC compared to the NCC regarding all subjective aspects. Thus, 
the usage of LISC can be considered in real-world applications to reduce work time with such 
large vehicle manipulators. 


Although the experiments provide strong indications of the advantages offered by the developed 
method compared to existing technical solutions, it is essential to acknowledge the limitations 
inherent in these experiments. Firstly, the definition of performance indices may vary in 
real-world applications. Furthermore, in many cases, the measurement and quantification of 
these indices may not be currently feasible from a technical standpoint. Secondly, the efficacy 
of the developed approach is heavily reliant on the operational environment. The extent to 
which the assistance system can actively support the operator remains uncertain, which may 
result in lower benefits than indicated by the studies conducted thus far. Finally, the subjective 
perception and acceptance of professional users with the developed simulator is difficult to 
estimate. Therefore, further studies should be conducted using a more realistic simulator. 
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To summarize the chapter, strong indications are derived from these experiments showing that 
the use of the LISC can have benefits in real-world applications for both manufacturers and 


customers. 


7 Conclusion 


This thesis focuses on continuous human-machine interactions, which characterize the operation 
of large vehicle manipulators used for road maintenance works. Although vehicle manipulators 
are the focus of intensive research, the systematical treatment of human-machine interactions 
with limited information is not addressed in literature. Through this thesis, limited information 
means that the automation cannot measure or observe a subset of the system state, which 
arises for robotic systems with unstructured working environments. 


In order to enable the shared control of such systems, the first notion of this thesis is the concept 
of the limited information shared control. It is assumed that a human controls the non-measurable 
system states and the automation strives to support the human to improve the performance 
on their task. The core idea is the introduction of the so-called cooperation state, which can 
model the mutual effort of the human and the automation. Moreover, cooperation state can 
also serve as a substitution for the system states being non-measurable for the automation. The 
design of the limited information shared control happens by matching it to a full information 
shared control, which is based on a shared control design from literature and necessitates all the 
system states to be measurable. On the contrary, the limited information shared control can 
operate with fewer measurements and can provide a similar support for the human operator. 
These advantageous characteristics of the limited information shared control make specific 
real-world applications feasible for the first time. The remaining challenges are calculating 
the parameters of the cooperation state in such a way that they can characterize this specific 
continuous human-machine interaction. 


To solve this challenge, the development of a systematic control design for the limited infor- 
mation shared controller is presented, which is the second contribution of this thesis. The 
core idea is that the so-called potential games would be appropriate for a compact substituting 
representation of shared control setup. However, the existing subclasses of potential games have 
restrictive properties. Therefore, an extension is required to enable broader use of the potential 
differential games. This thesis closes this gap and introduces the two novel subclasses: The 
near potential differential games and the ordinal potential differential games They are suitable for 
the modeling of continuous shared control setups and enable the systematic calculation of the 
parameters of the cooperation state. Finally, the feedback control law of the limited information 
shared controller is computed ensuring the optimality of the mutual effort. Thus, the proposed 
systematic design of the limited information shared controller enables the modeling and the 
control of continuous human-machine interactions with limited information. 


To enable the testing of the proposed limited information shared control and its comparison 
with other control concepts, a simulator was developed in the course of this thesis. First, the 
fundamental usability of the proposed concept was proved in simulation with simulated human 
behavior. These first analyses included challenging scenarios, in which the manipulator had 
challenging situations. The results show that the use of the proposed limited information 
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shared control can help the operator carry out the tracking task faster and more precisely 
compared to the state-of-the-art solutions. 


In order to evaluate the impact of the human behavior on the designed limited information 
shared controller, three different experiments were conducted including human test subjects. 
In the first one, the proposed limited information shared controller was compared to the full 
information shared controller and a non-cooperative controller in the case of the lateral control 
of large vehicle manipulators. The results showed that the proposed shared control with 
the novel design method does not have significantly different results compared to the full 
information shared controller despite the limited information. 


In the second experiment, manual control of the large vehicle manipulator was compared to 
the limited information shared control and to the non-cooperative controller. Manual control 
is the current state-of-the-art method. The main difference to the first experiment was that no 
reference to the manipulator was given to the test subjects in advance: The task was to reach 
defined goals with the manipulator, which corresponds to a more realistic scenario. The results 
strongly indicate that the use of the proposed limited information shared control is suitable for 
the applications of the large vehicle manipulator: It outperformed both manual control and the 
non-cooperative controller in each aspect. 


The first two experiments addressed the lateral control of the large vehicle manipulator. The 
third experiment presented the application of the limited information shared control for the 
longitudinal guidance. A comparison between the limited information shared controller and 
a non-cooperative controller was carried out. The results showed that significantly faster 
work was possible with the proposed limited information shared controller compared to the 
non-cooperative controller. 


The three experiments provide strong indications that the proposed limited information shared 
control and its design procedure have practical benefits and are applicable to both longitudinal 
and lateral control of large vehicle manipulators. 


This thesis closes the research gap regarding shared control systems with limited information 
by introducing novel modeling with the cooperation state, presenting a systematic design 
procedure, and providing the first propositions for the practical use of the concept in improving 
the performance of road maintenance works. 


A Solution Concepts of Games 


In game theory, there are three main solution concepts: The Nash Equilibrium, the Stackelberg 
equilibrium and the Pareto optimum, [vS*52, Par14]. In this section, the latter two are presented 
and the relevant differences between them are discussed. Furthermore, the choice of the Nash 
equilibrium is motivated, which can model human-automation shared control interactions, 
see [BOW09, LSB21, NC22]. In Section 3.1, the solution concept of the Nash equilibrium is 
presented. However, to solve the coupled optimization 


min J (u, uP) , VieP, (A.1) 


ul) 


there is further concepts in literature. 


A.1 Stackelberg Equilibrium 


Stackelberg proposed an alternative equilibrium solution concept [vS*52]. The Stackelberg 
solution concept assumes that the players determine their strategy in an ordered, sequential 
manner. A leading player sets his strategy first. Once the strategy of the first player is set, it 
cannot be changed and all the other players can take it into account by choosing their strategies. 
Then, the second player defines his strategy. The second player assumes that the following 
players will react to his strategy by optimizing their objective functions. This procedure 
continues until the last player set his strategy. Thus, the Stackelberg equilibrium is defined as 
follows. 


Definition A.1 (Stackelberg) 


(N)®* 


The solution strategy of a differential game u** = [uo ud” u U | is called 


the Stackelberg equilibrium and defined by the sequence of dynamics optimizations, 
such that 


ud“ (t) = argmin J (x(t), uV (t), ut), n uw (£)), (A.2) 
ul) (t) 
s.t. 2(t) = f (t,2(t), uP (t), uP (t), u(t), 
x(0) = xo, 
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u(t) = argmin J (a(t), u(t), 4 Mu), (A.3) 
ul?) (t) 
a a 7 (Heda Ouran), 


(0) = zo, 


w(t) =arg min JY) (w(t), w(t), w(t), w(t), wt), (Ad) 
uN) (t) 


te Oa” Ec) Oa) |, 
x(0) = zo, 


where u)” (t) Yi = {1,2, ..., N} are the fixed, Stackelberg-optimal inputs of the players, 
which can not be modified through the optimization J“), if, j >i. 


The order of the players has an impact on the optimum of the cost functions J and conse- 
quently on the resulting equilibrium of the game. Games with biased or asymmetric information 
patterns (e. g. markets with dominant companies) are modeled by means of the Stackelberg 
strategy. For more detail, it is referred to [BB81, BCS15, MB18]. 


A.2 Pareto Optimum 


Nash and Stackelberg equilibria are the solutions concepts of non-cooperative games in which 
the players do not collaborate in reaching the optimum of their own cost functions. Thus, 
players strive to improve their own cost functions only. An alternative solution is the so-called 
Pareto optimum [Par14], in which the players do not optimize of their own objectives only but 
also take into account the objectives of the other players computing the control actions. Using 
the Pareto solution, the players collaborate with each other in order ro reach the so-called 
Pareto optimum, which is also referred as Pareto-front. Due to this cooperation, these are called 
cooperative games. The Pareto solution is defined as follows [Eng05, Definition 6.1]. 


Definition A.2 (Pareto Optimum of Differential Game) 


The solution strategy of a differential game u* = [u uD” aay uN)?" | is called 


the Pareto optimum, if no other permissible strategy u = (ur, um),..., um] exists 
such that l 
JO (u) < JO (uP*) (A.5) 


holds for at least one player i € P and 


JO (u) < JO (uP*), VjeP,jri. (A.6) 


The strategy is a Pareto optimum if no other feasible strategy exists that would lead to a better 
outcome for at least one of the players but would not make the outcome of any other player 
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worse. Consequently, players in a cooperative game act differently compared to the players in a 
non-cooperative game. In a non-cooperative game, a player deviates from the Pareto optimum 
if this leads to a lower value of his/her cost function, regardless of the resulting disadvantages 
for the other players. Computation methods of the Pareto optimum of a differential game are 
presented in [RE14, LZ18]. 


Both the Stackelberg and the Pareto solution are widespread in the literature of game theory. 
However, they do not suit for the modeling of continuous human-machine interactions. In a 
shared control setup in accordance with Definition 2.4, a direct and formal coordination between 
the human and automation is not feasible. In a shared control setup, the interaction between 
the partners happens continuously through the state and the inputs of the controlled system. 
Thus, an agreement happens implicitly, in which all players rationally choose their inputs with 
respect to their individual objectives and continuously adapts to the other partner. 


As the result of these considerations, the Stackelberg and the Pareto solution concepts do not 
suit for the modeling of continuous shared control problems. This conclusion was reinforced 
through experiments, see [BOW09, LSB21, NC22], in which it has been shown that a continuous 
human-automation interaction can be modeled by means of Nash equilibria of a non-cooperative 
game. Therefore, the concept of Nash equilibria is used for the modeling of shared control in 
this thesis. 


B The Novel Models of the Vehicle 
Manipulator 


In this chapter the detailed models of the vehicle manipulators are presented to provide 
additional information to Chapter 5. First, the nonlinear control model is presented, which is 
followed by the detailed simulation model of the large vehicle manipulator. 


B.1 Derivation of the Nonlinear Control Model 


This section presents the novel control model of the vehicle manipulator, which can be used to 
control the dual trajectories of such system. This derivation is presented in the publication 
[VMSH19]. 


The controllers presented in this thesis controls the vehicle manipulator in planar, they require 
a design model of the vehicle manipulator system. Its characterisation happens through the 
following coordinate systems”? (Fig. B.1): 


e a global frame with the index O, 

e frame of the rear axle of the vehicle at the point Pyen, index v, 

e local frame on the reference path Iven of the vehicle, around the point P,, and 

e local frame on the reference path Iman of the manipulator, around the point P,n- 


Additionally the endpoint of the manipulator Pan is used for the derivation of the system 
dynamics. The equation of motion of the vehicle can be derived through the use of the velocity 
of the reference points P, and Pm. The derivation for car-like vehicles is presented in[SK08a, 
Chapter 49.2]. The vehicle manipulator are controlled by the steering angle of the vehicle ô, the 
length projected into plane, a and by the orientation a of the robotic arm. For such a system a 
generalization can be introduced. Defining the variables s, d and A9 for the vehicle (index v) 
and for the manipulator (index m): 


e Sy and Sm are the curvilinear abscissas at the points P,, and P, obtained by projecting 
P, and Pman orthogonally on I’, and I'm. These points are unique if the point-pairs are 
close enough to each other. 


« dy and dm are the lateral displacement from the reference path of the vehicle and the ma- 
nipulator in m. They are expressed in the orthonormal basis of the reference trajectories 
at the points Py and Pinan. 


48 Note that the unit vectors are marked as i and j instead of x and y to avoid confusion with the latter system states. 
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- Ad, is the orientation error of the vehicle in radian, AO, = Oy - Ory 


e and Ad, is the manipulator’s orientation angle from end-manipulator’s frame to the 
vehicle’s frame in radian, AO, = 0, - Orm- 


e The variable v without any index is the velocity of the rear axle of the vehicle in m/s 
which is necessary for the further derivation. 


e The reference trajectories are described through their curvature, Kyy and Kym in 1/m. 


The bicycle model is given according to [SK08a, Chapter 49.2]: 


Syeh = =. da a Ta cos(Ad,en); 
dveh = Uveh sin( Aven), (B.1) 
tan(6) 


Abeh = Uveh Zu SyehKry- 


L 


The idea of joint-dependent variables (a and a) can be found in some earlier works [MAD14] 
[MAD16], but only for small indoor robots in global frame for task priority redundancy resolu- 
tion or dual-trajectory control. 


In the following, the manipulator dynamic in the Frenét-frame is derived. The curvature of e.g. 
T man at the point P,m is defined as Kym = O0;m/O5m. This definition yields after substituting the 
time derivation of the manipulator’s transformation angle 


DO vie = Öven Oi = Beh firm $rm- (B.2) 
Secondly, the position of Pman in the global frame O is required: 


=. Ze . . . 
OP man = OPyen + ((L + 1) + acosa) iveh + asin Ajyen- (B.3) 


Figure B.1: The detailed lateral control model of the large vehicle manipulator for the derivation of the equations of 
motion and the applications of the FISC and the LISC design [VMSH19]. ©2020 IEEE 
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With respect to the reference path of the manipulator, OP man is alternatively computed as 

— — x 

OP man = OPım + Aman)ım (B.4) 
and the time-derivation of (B.3) is 


JOP man OOP ði 
mansa Ve <i: (L+1) aa + (à cosa - aġ sin a) iyeh 


Ot Ot 
a Oiven ih s . 
+a cosa + (@sin a + a@cos@) Jveh 
A Ojveh 
+asina ; B.5 
AG (B.5) 
With the substitution of 
. . > 
Oiveh -@ ij Ojveh = a) i and OOP veh ary 
dt vehJveh > dt vehtveh a t veh 
the equation of motion (B.5) is 
JOP 
ae = (v + å cosa — a(Öyen + à) sin a) iveh 
+ ((L+l)Oven + åsin a + acos@(Öyen + &)) jven- (B.6) 
The same velocity is computed from the reference path of the manipulator in (B.4) 
IOP man OOP 8 
man a rm + d . 
dt ot 8 (dmandım) 
=$man(l = dman rm )irm + dmanJrm- (B.7) 


Assuming dman * Krm X 1 and transforming the manipulator’s path coordinate system to the 
vehicle coordinate system, the dynamics of the manipulator is identified in the terms of equation 
(B.7) and equation (B.6) as follows: 


Sman = COS Afman (v + &COSQ — aÅ CO8 Q — Adyen Sin a) 
-sin AO man (L+ 1) Over + adyen COS + å sin & + aå cos a) (B.8) 
and 
dman = sin Abman( v + å COS Q — a COS A — ayen Sin a) 


+ COs A man (L + 1) Oyen + Oven COSA + å sin a + aÅ cos a). (B.9) 


Substituting (B.8) in the equation (B.2), the manipulator’s transformation angle is 


Adnan = rn cos Afman (v + å COS Q — aA COS Q — adyen Sin a) 


-sin Abman( (L + 1) Oyen + adyen COS + ASIN + aå cos a) (B.10) 
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The equations (B.1), (B.8), (B.9) and (B.2) are used as the state space equation of the dynamic 
system. 


To obtain a linear control model of the vehicle manipulator, the input vehicle’s curvature is 
introduced from (B.1), Ky = ale), Thereby the input vector is 


í T 
u(t) = [Ky, Ades, Qdes | 


where å and «are the changing rates of the length and the angle of the manipulator. The state 
vector is chosen to 


x(t) = [dm, Aa, dy, Ad] o] 


where Aa = a - a, and ar is the desired reference orientation of the manipulator. Note that 
including (B.10) in the state vector is not necessary. However to formulate a model predictive 
controller with constraints on the angle WO man, the system state vector should be extended, see 
for more details [VMSH19]. The changes of the trajectories of the vehicle and the manipulator 
constitute the external disturbance vector 


z(t) = [Key km] 
Thus, a linear control model can be formulated 
x(t) = A(t)Ax(t) + B(t)Au(t) + ZAz(t), (B.11) 


where the time variances of the system matrices are caused by the variation of the longitudinal 
velocity of the vehicle. For constant speed, the model (B.11) is time-invariant, such as it is 
assumed in Chapter 5. 


The parameters of the control models are given in Table B.1. 


Table B.1: Parameters of the linear control model 


Parameter Abbreviation | Value 
Vehicle velocity Vyeh 1.27 
Axle distance L 2.6m 
Reference Manipulator orientation Ar 1.1rad 


Reference Manipulator length ar 3.1m 
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B.2 Detailed Simulation Models of Vehicle Manipulator 


The following section presents the simulation models of the vehicle and the manipulator 
followed by further information on the low-level controller of the simulation models. 


B.2.1 Simulation Model of the Vehicle 


In this section, the detailed three-dimensional model of the vehicle is presented, which is 
developed in the course of this thesis. Parts of the implementation were conducted in the 
course of the master’s thesis [Mai18]. The results are published in research articles [VMSH19, 
VMH22]. 


In order to be able to investigate the effects of the hydraulic manipulator on the vehicle, a 
nonlinear three-dimensional vehicle model is selected. Depending on the application, large 
forces and torques can act from the robot arm on the vehicle. These can lead to rotational angles 
of the vehicle chassis that are not negligible. All simulation models of the vehicle manipulator 
are derived with the Newton-Euler formalism (see e. g. [WW08, Section 3.4]), in which the 
two laws of the classical mechanics are applied: The conservation of the linear and angular 
momentums, which can be formulated such that 


F=m-r (B.12) 
T =Ow+wx Ow, (B.13) 
where 
« F is the sum of the forces, which act on the rigid body’s center of mass 
e mis the mass of the rigid body 
e ¥ is the acceleration of the rigid body’s center of mass 
e T is the sum of the torques, which act on the rigid body’s center of mass 
« © rigid body’s mass moment of inertia 
e w is the rigid body’s angular velocity 
Figure B.2 illustrates the model of the vehicle including 
e one vehicle body with six degrees of freedom, 
e two suspension systems with two degrees of freedom, 
e four wheels with two two degrees of freedom. 


These subsystems are connected with spring and damp elements as given in Figure B.2. For 
each subsystem, the kinematic relations are set up, leading to the transformation matrices 
between them. Furthermore, the Newton-Euler equations of motion (B.12) are formulated for 
the subsystems and their motions are computed. 
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Figure B.2: The simulation model of heavy duty vehicle including seven subsystems (one vehicle, two suspension 
systems and four wheels) modeled as rigid bodies 


Orientation of rigid bodies is represented with Euler angles roll, pitch, yaw, (@zu, Sku, Yeu); 
which include three chained rotations and describe the rigid body’s orientations in a fixed frame 
Ogiob. Their use is intuitive and easy to apply. However, the order of the chained rotations 
have an impact on the resulting final orientation of the rigid body. To compute the angular 
velocities of a rigid body for (B.12), in practice, the assumption is made that at least two of the 
Euler angles are small and therefore the angular velocity is computed such that 


Wy ay u 


w2 =| g . (B.14) 
w3 Jaib LYEulcıon 


@ 


In the case of passengers cars, a common assumption is that the roll and pitch angles are 
small and the yaw angle is large, which is valid for most of the test scenarios. However, in 
the case of heavy duty vehicles(B.14), this assumption is not feasible*’, see [PBLB06, LYLC10]. 
Furthermore, the inertia of the rigid body © is usually estimated for the center of mass of heavy 
duty vehicles. Due to the complex mechanical structure of heavy duty vehicles, a transformation 
of (B.12) into an arbitrary point, solving the problem of large Euler-angles, is not practicable in 
general case. 


49 Tn literature, there are further works, which decouple the three motions and use planar models only, see e. g. [LH05, 


GB21] or [Ril11, Chapter 7-9]. However, this thesis attempts to build a more general model enabling realistic 
simulations. 
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Due to these reasons, the notion from [KNH14] is applied to overcome the aforementioned 
challenges. The fundamental idea is the use of a rotated coordinate system Oot, in which the 
angular velocities can be given with 


Wy W1Rot 
w| =| 0 . (B.15) 
W3 IGlob 0 frot 


Using (B.15), the three dimensional rotation is reduced to one single rotation, fulfilling % = 
W1Rot, see Figure B.3. This procedure includes three steps: 


e Calculating the local, rotating coordinate system Opot, which leads to the rotating 
coordinates 71, 72,73. 


e Computing the rotation y = J W1Rot around rı in ORot. 
e Transforming y into OGlob from which agu, PEu, YEu are obtained. 


These steps are numerically computed for each time step. The solver and the time step of 
the resulting differential equations are Runge-Kutta and 0.5 ms, respectively. For the detailed 
mathematical derivation of these steps, it is referred to [KNH14]. 


The dynamics of the steering system is modeled by means of a PT1 system part with 0.2s time 
constant, leading to following subsystem dynamics 


act = —5dact + Ödes- (B.16) 


The longitudinal model of the vehicle manipulator includes a combustion engine model consist- 
ing of a static rotation speed-driving torque map and a PT1 transfer function, which is inspired 
by [Ril11, GF12]. Table B.2 provides the parameters of the vehicle model, which are estimated 
based on literature, see [LYLC10, PBLB06]. 


Oglob 


Figure B.3: Illustration of the angular velocity based local coordinate system to solve the computation problem of the 
Euler angles 


XXXII B The Novel Models of the Vehicle Manipulator 


Table B.2: Parameters of the vehicle simulation model 


Parameter name Symbol Values Unit 
Mass of the vehicle Myech 7500 kg 
Moment of inertia of the vehicle Oven 18000 kg/m? 
Mass of a wheel Mwhl 50 kg 
Moment of inertia of a wheel Own 7 kg/m? 
Mass of a suspension Wisi 300 kg 
Moment of inertia of a wheel Osus 350 kg/m? 
Distance between front and rear axes L 2.6 m 
Half track distance of an axis leas 0.7 m 
Dynamic radius of a wheel Tw,dyn 0.2 m 
Distance between suspension’s mounting h 0.7 en 
point and center of mass of the vehicle u i 
Distance between the two mounting 

: . Deus 1.4 m 
points of one suspension 
Spring stiffness Cspring 30> 104 N/m 
Vertical stiffness of a wheel Cwhlz 2-10° N/m 
Vertical damping of a wheel Cwhlz 100 Ns/m 
Linear damper factor daamp 3-2- 10°  Ns/m 
Sideslip stiffness of a tire Cwhly 65° 10° N 
Longitudinal slip stiffness of a tire Cwhl,x 8-105 N 


B.2.2 Manipulator Model 


For the manipulator model, parts of the implementations were carried out in two bachelor’s 
theses [Bou19, Bur19]. The nonlinear hydraulic model of the manipulator is presented in this 
section, see Fig. B.4. The model of the manipulator includes 


e Mechanical model including four rigid body segments 
« The hydraulic actuators 


« The model of the electrical control unit of the hydraulic actuators 


The mechanical models are derived with New-Euler formalism, implemented in a Simulink 
model and solved numerically. The hydraulic models are implemented based on the works of 
[Rud17, Rud18]. The system states of the hydraulic model are the angular velocity of the joint 
ġ and the load oil pressure of the cylinder Pz. The nonlinear dynamical model is formulated 
as follows 


pa tba | 
V; 
$= : (Pr: Anya- f(6)); (B.18) 


Mman,i 


-¢) (B.17) 


B.2 Detailed Simulation Models of Vehicle Manipulator XXXII 


Figure B.4: The simulation model of the large manipulator including the four rigid body segments and the four 
hydraulic cylinders 


where f (6) is the non-linear, velocity-dependent Stribeck friction model. Mman,; is the mass 
of the corresponding manipulator segment. The input of the cylinder is unya, which is the 
function of the desired angular velocity of the joint dacs. The non-linear input equation is 


‚1 : 
Qr = ZhydKnya 3 (Pr = sign(Znya)Pr), (B.19) 


where Pr is the reservoir pressure. The servo valve governing the oil flow Qz is approximated 
by a second order system, where the position of the spool is the output. Its transfer function is 
given as 

Ù + WnyaWnyal + WhyaY = Whyathyd (B.20) 


where the parameters 7, and wp are the damping and wo is the natural frequency of the servo 
valve. The spool has a dead zone area, which is modeled by 


Qhyd* sign(v) if|v| < hyd + Bnya 
Zhyd = h(v) = 40, iflv| < Bhya; (B.21) 
v - Bnya-sign(v) otherweise, 


where the parameter anya the saturation of the valve and nya is the width of the dead-zone. 
The sign(v) functions are replaced by the arctan( Kẹ - v) functions reducing the numerical 
oscillations around db = 0 rad, where Kẹ = 50 holds. Using (B.17)-(B.21), the motion of the 
hydraulic cylinder can be reproduced accurately. The illustration of the low-level control loop 
with the models presented above is given in Figure B.5: The orange-colored box of the human 
operator symbolizes that this system part is replaced in the experiments by the human operator. 
On the other hand, the green subsystems with the dashed-line box remain the same in both 
simulation and experiment. The feedback gain of the low-level hydraulic controller is chosen 
to Knya = 0.0225. The further parameters of the manipulator with and their numerical values 
are given in Table B.3, which are estimated based on data from [Rud17, VGJ19, WWXS22]. 
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Forward Kinematics 


enum ss se we ew eee m m m 


Figure B.5: The structure of the hydraulic system with the corresponding models and the low-level control loop is 
shown. The green dashed line defines the components, which are used in both simulations and experiments 


unmodified. 
Table B.3: Parameters of the manipulator simulation model 

Parameter name Symbol Values unit 
Masses of the four segments Mmani | [150, 200, 200, 350] kg 
x&-Moment of inertia of the four segments | Oz; [23.3, 370, 460, 45] kg/m? 
y-Moment of inertia of the four segments | Oyy, [23.3,370,460,45] kg/m? 
2-Moment of inertia of the four segments | O,, ; [5, 12, 12, 7] kg/m? 
Lengths of the four segments li [12.52.71.2] m 
Distance between manipulator mounting ] 07 = 
point and front axis of the vehicle p ` 
Saturation of the valve is Qhyd 5.10? m 
The width of the dead-zone Bnya 2.1074 m 
Piston area Ahya 1-107? m? 
Reservoir pressure Pr 2.5- 107 Pa 
Total hydraulic volume Vi 0.4 m’ 
Valve flow coefficient Kaya 6.3- 10-4 - 
Damping ration of the control valve Chyd 0.7 = 
Eigen-frequency of the control valve Whyd 100 rad/s 
Bulk modulus of the hydraulic oil Ehya 1-108 Pa 


C Additional Simulation Results 


This chapter provides additional simulation results for Chapter 5. The first part includes 
additional figures for Section 5.3. In the second part, the results of an additional scenario 
validating LISC in Section 5.4.2 are given. 


C.1 Simulation Results of the Potential Games 


In this section, additional figures for Section 5.3.2 are provided. The resulting noise-free 
trajectories of the identified OPDG are given in Figure C.1 and Figure C.2 presents the dynamics 
of the Hamiltonians. It can be seen that in the noise-free case, the input-trajectory-dependent 
identification of OPDG generates similar Hamiltonian dynamics compared to the noisy case in 
Section 5.3.2. Thus, the robustness of the input-trajectory-dependent identification of OPDG is 
ensured through this preprocessing making the method suitable for practical application even 
with noisy measurements. 


— Asn ODG Ad, ODG — Asman ODG 
=== Ad, OPDG - =- Ad, OPDG ==- ASman OPDG 


-0.5 | | | | | 
0 5 10 15 20 25 


Time in s 


Figure C.1: The resulting noise-free system state trajectories of the longitudinal vehicle manipulator and the identified 
OPDG 
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Figure C.2: The dynamics of Hamiltonian functions comparing the results of the original differential game (ODG) and 
the ordinal potential differential game (OPDG) 


C.2 Additional Validation Scenario with the Vehicle 
Manipulator 


This section present an additional simulation scenario, in which the reference path of the 
manipulator is the combination of a smooth curve and a sudden step. The resulting trajectories 
are given in Figure C.3 comparing the proposed limited information shared controller to 
the non-cooperative controller. As it can be seen, after entering in the smooth curve, both 
limited information shared controller and the non-cooperative controller maintain the reference 
similarly. During the sudden step, the limited information shared controller can help the 
operator to maintain the reference of the manipulator. On the other hand, the non-cooperative 
controller does not support the operator, thus the tracking of the manipulator’s reference is 
less precise. The desired and actual angles of the manipulator are given for both cases: Using 
LISC, see Figure C.4 and NCC, see Figure C.5. Comparing these two figures, it can be seen that 
LISC eases the operation: smaller desired angular velocities are set, which can be followed 
more accurately, see second and fourth joints. Consequently, LISC is also beneficial in this 
additional qualitative validation scenario. 
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Figure C.3: Additional scenario for the qualitative validation: The combination of a larger curve and a sudden step 
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Figure C.4: Additional scenario for the qualitative validation: The desired and set angular velocities of the manipulator 
angles using LISC 
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Figure C.5: Additional scenario for the qualitative validation: The desired and set angular velocities of the manipulator 


angles using NCC 


D Supplements of the Experiments 


D.1 Equivalence Testing 


This section provides a short introduction to the equivalence testing and its emerging challenges. 
These challenges are increasingly being brought into focus by research communities. For 
instance, in [Lak17], it is stated that "Currently, researchers often incorrectly conclude an effect 
is absent based a non-significant result". Furthermore, the misconceptions of the equivalence 
testing were addressed in [GLM02], which points out that many textbooks fail to handle this 
subject area correctly. Based on the non-significant result of a statistical test for superiority, 
equivalence cannot be concluded: "The absence of evidence is not evidence of absence" [Ald04]. 
Therefore, in such cases, so-called equivalence or non-inferiority tests need to be developed, 
which can verify the equivalence or non-inferiority of a new method compared to a recognized 
standard method. Such equivalence or non-inferiority tests are widely used in medicine and 
pharmacotherapy research, in which the goals of studies are not to test the superiority of a 
therapy”, but to verify the equivalence or non-inferiority (e. g. the new therapy has fewer side 
effects, is cheaper, but still has an equivalent effect.) 


In literature, the commonly used statistical hypothesis tests attempt to show that there exists a 
statistically significant difference between two or more data sets. Figure D.1 shows an exemplary 
illustration: Ho and H; are presented as a function of the difference AM = Mı - Mə. The 
x-axis shows AM between the means of the new method Mı and the standard method Mə. 
The null hypothesis Ho is that the means of the two methods are statistically identical. The 
alternative hypothesis H; is that there is a difference, which is characterized statistically. The 
mathematical formulation of these two hypotheses is 


Ho : Mı = Ms, (D.1a) 
Hy: Mı # Mo, (D.1b) 
where one-sided tests provide an evidence that Mı < Ma (left-tailed test) or Mı > Mə (right- 
tailed test). If the difference is analyzed in both directions at the same time, Mı > Ma and 


Mı < Mz, the test is two-sided. Using a statistical test, a probability value (p-value) is obtained, 
which quantifies the probability that H; is true such that 


p=Pr(T<t|Ho), in case of left-tailed tests, (D.2) 
p=Pr(T >t|Ho), in case of right-tailed tests, (D.3) 
p=2-min {Pr (T < t|Ho),Pr(T >t|Ho)} in case of two-sided tests, (D.4) 


50 Note that the usage of equivalence or non-inferiority testing is widespread in medical research and in clinical trials, 


therefore the majority of the publications from literature use the terminology "therapy" or "treatment" instead 
of "method". However, due to the technical focus of this thesis, the term "method" is consequently used in the 
following. 
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Figure D.1: Classical hypothesis testing, analyzing the difference between Mı and M2. 


where t is the result of the test-statistics from the distribution T, see e. g. [HKR15, Chapter 9]. 
Depending on the data distribution, different statistical tests suit for the testing of Hı. Overviews 
and guidelines are given in [VB99], [VA19, Chapter 1]. 


On the other hand, the absence of such a difference in (D.1) does not imply automatically 
the equivalence of Mı and Ma [LSI18]. Therefore, a new formulation of the statistical test is 
necessary, for which an equivalence margin is defined by a lower Ajower and an upper Aupper 
equivalence limit. The null and the alternative hypotheses are formulated as follows: 


Ho : Mı - Ma > -Ajower and Mi - Mo < Aupper: (D.5a) 
Hy: —Ajower < Mı- Mo < A upper- (D.5b) 


Figure D.2a presents the equivalence testing procedure graphically. The null hypotheses 
Ho states that the difference between Mı and Ma is outside the equivalence interval. The 
alternative hypothesis H; is that AM is located inside the equivalence interval, which can 
be symmetric Ajower = Aupper as well as non-symmetric Ajower + Aupper- The choices of 
Alower and Aupper are always application-specific. In [CGA04, WN11], guidelines and best 
practices are presented pointing out the importance of a carefully considered choice of Ajower 
and Aupper- 


On the other hand, non-inferiority testing answers the question only, whether the novel method 
M; is not worse than the standard method Mg, thus, a better M; is acceptable. From its formal 
definition 


Ho : M, = Mə 2 —Ains, (D.6a) 
Hy E Mı = Ma < -Aunf, (D.6b) 


Figure D.2b illustrates the fundamental idea of the non-inferiority testing. 


An intuitive solution concept for the equivalence and non-inferiority tests is the idea of the 
two one sided tests (TOST)*! [HA84, RHV93, LW95, LC97, Zha03]. In the TOST procedure, the 
difference AM is tested against the upper and lower bounds forming two composite null 
hypotheses cf. (D.5a). If both one-sided tests of (D.5a) can be statistically rejected, (D.5b) can 
be concluded. In the case of a non-inferiority test, the procedure is similar. The difference is 
that (D.2ba) includes one one-sided test only. Widespread is the use of TOSTs based on the 


51 In literature, the abbreviation "TOST" is often limited to two one sided t-test". However, in [Lak17], it has been 


shown that the t-test can be replaced by non-parametric methods e. g. Wilcoxon signed rank test enabling a more 
general use of the TOST procedure. 


D.1 Equivalence Testing XLI 


Student’s t-tests. In [Lak17], it has been shown that the TOST approach can be extended for 
non-parametric tests making the TOST more pertinent. 


An alternative solution for non-parametric equivalence hypothesis testing is the so-called 
signed rank equivalence test, see [Wel10, Chapter 5.], which does not include two explicit 
statistical tests against Ajower and Aupper. Instead of testing these bounds, the so-called 
rejection probability value Cerit is computed, which is compared with a calculated statistics 
rank Cyn. The computation of the critical value depends on the equivalence distribution range 
(q',q”) of the data. This equivalence distribution range can be obtained from a numerical 
solution of a density function’? f, and the defined significance level a. The null hypothesis of 
the test states that there is no equivalence between the two data sets. The alternative hypothesis 
states that the two data sets are equivalent. If Cerit > Crk, the null hypothesis is rejected and 
the alternative hypothesis is accepted: The two data sets are equivalent. It is also referred as 
Wellek’s Signed Rank Paired-Sample Test for Equivalence or Wellek’s equivalence test, cf. [MC12]. 
For more details and mathematical basis on Wellek’s equivalence test, it is referred to [Wel10, 
Section 5.4]. 


Due to the less practical usability and adaptability of the Wellek’s equivalence test for engi- 
neering applications, in this thesis the TOST methods are applied for the equivalence and 
non-inferiority tests of the hypotheses from the experiments. 


In the programming languages Matlab and Python, equivalence test methods have limited 
availability. On the other hand, the programming language R provides more open-source 
libraries including the implementations of various equivalence test methods, see [Cal22]. In 
the course of this thesis, Matlab versions of these equivalence tests were implemented”. 


Ho : Hı ] Ho 
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(a) Equivalence testing with the equivalence interval, which is defined by the upper and lower margins Ajower and Aupper- 


Ho À Hı 
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(b) Non-inferiority testing with the effect limit A;nr 
Figure D.2: The illustration of equivalence and non-inferiority tests. The main difference is that the non-inferiority 


test allows the superiority of Mı compared to Ma. On the other hand, an equivalence test necessitates a 
strict limitation of AM = Mı - Mz to the equivalence interval. 


>? The derivation of this density function is presented in [Wel10, Section 5.4]. Furthermore, it has to be computed 


numerically by means of a bisection method. Therefore, in [Wel10, Section 5.4], table overview of the values pairs 
are given, which are commonly used in medical research. 

Hypothesis testing for equivalence with Matlab, https://github.com/vargabalint92/Hypothesis- 
testing-for-equivalence-with-matlab 
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D.2 Choosing the Proper Statistical Test Methods 


This section provides a short overview of the different test approaches and categories, in order 
to provide clarification of the chosen test methods in the experiments. This section is based on 
[VB99, DMI03] and [VA19, Chapter 1]. 


Statistical variables can be categorized into two main groups quantitative variables and categor- 
ical variables. 


« Quantitative variables are variables having certain quantities, amounts or ranges. They 
can divided into two subcategories 


a) Continuous variables can have continuous value (uncountable) obtained by mea- 
surements e. g. error to a reference, velocity, time or age 


b) Discrete: e. g. obtained by counting e. g. scores in an exam or goals in a soccer match 
« Categorical variables are arranged into discrete categories, which can be 


a) Ordinal variables mean that their values are comparable (have a ranked order), 
e. g. Likert scale or age groups (0-18, 18-65, 65+) 


b) Nominal variables are assigned into groups without natural order e. g. days of a 
week, names 


In this thesis, the independent variables (also called manipulated variable) are the types of the 
controllers. They are nominal categorical variables. The dependent variables (also called output 
variables) are the results of the defined measures, which are specified in the corresponding 
sections. In the case of the subjective assessment, the controllers are evaluated by Likert scales 
leading to ordinal dependent variables. As a consequence, the subjective measures need be 
analyzed with non-parametric test methods, see [VB99]. On the other hand, in the case of 
the objective measures, the dependent variables are quantitative: In the first experiment, the 
distance from the reference is measured and in the third experiment the overall time necessary 
to finish the task. These are continuous variables. On the other hand, the number of the 
collected boxes in the second experiment is a discrete dependent variable. First, they have to 
be tested for the normality of the measurements and for the homogeneity of their variances. 
These tests are carried out with the so-called Shapiro-Wilk test and F-test. 


The Shapiro-Wilk test is a statistical significance test that determines the hypothesis that the 
underlying measurement has a normal distribution. Its null hypothesis assumes that the data is 
normally distributed with unspecified mean and variance with the significance level aS’. The 
alternative hypothesis is that the data does not have a normal distribution. If p>“ < a5 holds, 
the null hypothesis is rejected and a normal distribution cannot be assumed. On the other 
hand, if the p-value of the Shapiro-Wilk test is larger then the significant level, the alternative 
hypothesis is rejected and a normal distribution can be assumed for the data. These tests are 
necessary to decide whether parametric or non-parametric statistical tests should be applied. 


An F-test verifies whether the two data sets with normal distributions have the same variance. 
Its null hypothesis is that the two data sets are normally distributed and have the same variance. 
The alternative hypothesis is that the two data sets are normally distributed and have the 
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different variance with the significance level a. If p" < a holds, the null hypothesis is 
rejected and the equivalence of the variances cannot be assumed. On the other hand, if 
the p-value is larger then the significant level, the alternative hypothesis is rejected and the 
equivalence of the variances of the two data sets can be assumed. 


In the evaluation, the Matlab (2021b) implementation of tests are used”. In the aftercoming 
sections, the measurement data for the experiments is given providing further explanations 
and the traceability of the results. 


> For more details, the clickable links lead to the corresponding description of the functions, last accessed on January 


12° 2023: 

Shapiro-Wilk: https://de.mathworks.com/matlabcentral/fileexchange/13964-shapiro-wilk- 
and-shapiro-francia-normality-tests 

F-test: https: //de.mathworks.com/help/stats/vartest2.html 
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D.3 Experiment with Reference Trajectories 


D.3.1 Results 


The average deviation of the manipulator using the three controllers are given in Table D.1. 
They were tested with Shapiro-Wilk test for the normality condition. The significance level of 
the Shapiro-Wilk test was chosen to a®W = 0.05. The obtained p-values are 


Prise = 0.006, poc 83:10 and pre 73510, 


which are all smaller than the significance level. Therefore, a normal distribution cannot be 
assumed. Additional graphical illustration of the objective results are given in Figure D.3. It 
can be seen that the results of the test subjects using LISC and FISC are similar in contrast to 
NCC. 


Table D.1: The average errors of the manipulator in the first experiment in m 


Nr. Test FISC LISC NCC 
Steps V-forms | Steps V-forms | Steps V-forms 
1 0.90 0.70 0.88 0.60 0.84 0.80 
2 0.51 0.14 0.47 0.20 0.71 0.22 
3 0.50 0.11 0.61 0.11 0.70 0.25 
4 0.54 0.16 0.39 0.20 0.67 0.28 
5 0.52 0.09 0.57 0.14 0.75 0.26 
6 0.51 0.11 0.36 0.14 0.72 0.25 
7 0.51 0.12 0.49 0.13 0.70 0.17 
8 0.54 0.10 0.72 0.11 0.83 0.25 
9 0.48 0.08 0.45 0.14 0.58 0.22 
10 0.52 0.10 0.44 0.17 0.64 0.17 
11 0.53 0.08 0.57 0.15 1.14 0.54 
12 0.51 0.08 0.64 0.09 0.76 0.24 
13 0.49 0.09 0.52 0.12 0.77 0.20 
14 0.49 0.07 0.38 0.12 0.62 0.20 
15 0.52 0.09 0.50 0.08 0.83 0.19 
16 0.51 0.15 0.48 0.22 0.70 0.22 


The subjective assessments are given in Table D.2, which happens by analyzing the three 
questions of the subjective assessment. 


D.3 Experiment with Reference Trajectories 


1.2, 


dm in m 
oO 
a 


0.4, 


LISC NCC FISC 


Figure D.3: Box plot of the average error from the reference of the manipulator in the first experiment 


Table D.2: The subjective results of the first experiment including three questions 


Nr. FISC LISC NCC 

Qı Q2 O3/Q01 Q2 O3]Q1 Q2 Q3 
1 7 8&8 8 |6 ® 69 7 3 
2 7 7 7/6 6 7/3 3 3 
3 7 6 7/9 0 9 | 5 3 3 
4 8 8 8/7 8 7/6 6 6 
5 6 9 8ls 9 0]5 3 6 
6 7 8 818 735 8/3 2 1 
7 9 10 9 | 8 9 8/7 6 4 
8 9 8 9/5 6 6/6 4 5 
9 8 & Sa 6 503 3 1 
10/5 4 3/7 7 6|6 5 4 
uls 8 9/4 5 5/0 0 o0 
2/7 7 8|6 6 7|4 2 0 
3 7 7 7|8 8 8|5 3 3 
4 |8 9 8/6 7 6/3 3 3 
sie 9 9|5 6 6|7 7 7 
6 l9 9 9|83 7 8|7 7 7 
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D.3.2 Additional Trajectory Results 


Additional trajectories from further test subjects showing the similarities between FISC and 
LISC. Furthermore, the benefits of LISC compared to NCC is also illustrated. 


== FISC Manip = ==LISC Manip Ref Manip 
== FISC Vehicle = = = LISC Vehicle Ref Vehicle 


y distance in m 


20 30 40 50 60 70 80 90 100 
x distance in m 


Figure D.4: Comparison of the trajectories test subject 7 using FISC and LISC is shown. 


=== NCC Manip — ==LISC Manip Ref Manip 
== NCC Vehicle = ==LISC Vehicle Ref Vehicle 


y distance in m 


| | | N ji 
20 30 40 50 60 70 80 90 100 110 
x distance in m 


Figure D.5: Comparison of the trajectories test subject 8 using NCC and LISC is shown. 
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D.4 Lateral Trajectory-free Experiment 


This section documents the results of the second experiment allowing the reader to retrace the 
analysis. First the instruction page and the questions of the second experiment are provided. 


D.4.1 Instructions 


The Fig. D.6 and Fig. D.7 show the explanations of the experiment and the instructions for the 
test subjects. 
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NUT 


Karlsruhe Institute of Technology 


Instructions — Experiment 2 (Q) 


Lateral control of a large vehicle manipulator 


A large vehicle manipulator consists of a manipulator (1) and a vehicle/tractor (2), see figure. 
The operator of such a work machine has a dual task: He must guide the vehicle along its path 
(e.g. the middle of the road) and perform various tasks with the manipulator. In order to 


relieve the operator, the automation of the vehicle is 
reasonable. The operator remains part of the system 
and performs the task with the manipulator. The aim 
of this experiment is the evaluation and comparison 
of two different automation concepts to the manual 


operation that is common today. 
You have the task of maintaining the green areas 


along the streets. The simulator represents this 
scenario. 


Task formulation: 


The specific task is to collect as many blue boxes as 
possible with the manipulator. The manipulator can be 
controlled in X and Y directions using the joystick. With 
the position of the joystick you set the speed of the 
manipulator. With manual operation, you also have to 
steer the vehicle with the steering wheel so that it 
follows the gray trajectory (dual task). For safety 
reasons, you must not touch the steering wheel when 
using the automation concepts. 


In the zeroth run, you practice manual operation. 
(Demo/Training scenario). The result is not evaluated. 
You are welcome to experiment with the system and 
try out the controls. 


You then carry out three runs (two with one of the two 
automation concepts each and one with manual 
control). The order of the runs and the currently active 
concept can be seen at the top of the screen. After 
each run, the “Intermediate Questions” must be 
answered. 


At the end of the study you have to answer ,,Evaluation 
Questions”. 


IRS 


Institute of Control Systems 


Figure D.6: The instructions of the test subjects for the second experiment, page 1 
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NUT IRS 


Karlsruhe Institute of Technology Institute of Control System: 


Additional information: 


- Please pay attention to the length of the 
manipulator: it should be neither too short nor too 
long. The image shows the maximum length with a 
'break' to warn you. 


- The optimal orientation of the arm is 90° to the 
vehicle: This allows the future target points to be 
recognized early enough. 


- The tree icons are only there to show the vehicle 
movement. They are not obstacles, which have to be 
avoided. 


- Not all boxes can always be reached. Don't try to collect them all, try to collect as many as 
possible. 


- The scenario represents an artificial emulation of reality, which may not necessarily be 
intuitive (e.g. the constant working speed). If you need more time to understand how it works, 
you can repeat the zeroth run. 


Thank you for your participation in the experiment! 


Figure D.7: The instructions of the test subjects for the second experiment, page 2 
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Intermediate questions to evaluate the assistance systems 


0. Which Concept have you had? 
o Man o Aut1 o Aut2 
Answer with a tick for each question. 
1. Have you followed the task? 
o Yes o Partly o No 
2. Have you become noticeably better with time? 


o Yes o Partly o No 


3. How well were you able to perform the assigned tasks? 


After each run 


oO oO oO (0) oO 
Very Good Neutral Very Bad 
4. The task was very demanding. 
Q oO oO oO oO 
Not phar Partly Very applicable 


5. The automation was ... . 


f the vehicle guidance was automated, complete the following sentences: 


oO o oO oO 
Very helpful Neutral 


oO 
Not helpful at all 


6. The automation was .... 


(0) oO oO (0) 


Very intuitive Neutral 


ie) 


Not intuitive at 
all 


Further remarks, feedbacks or comments: 


Figure D.8: Intermediate questions of the second experiment 
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LI 


Age: 
Gender: 


was able to ... fulfil the task(s) set. 


Date, time 


Questions for the evaluation of the assistance system lateral control 


Not good at Not good Rather not Partly-Partly | Rather good Good Very good 
all good 
Aut 1 
Aut 2 
Man 
found the way of working with the automation concept ... 
Not intuitive Not intuiti Rather not Bariban Rather Intuiti Very 
at all PENS intuitive AAN intuitive ae intuitive 
Aut 1 
Aut 2 
Man 
felt optimally (mentally) stressed. (mental/cognitive strain). 
Not applicable Not Rather not Rather . i 
at all applicable applicable Partly applicable Applicable | Very applicable 
Aut 1 
Aut 2 
Man 


If not applicable: was your mental/cognitive load too 


had the feeling that | was in control of the process. 


little or too much? 


Not applicable Not Rather not Rather 5 n 
atall applicable applicable Partly applicable Applicable | Very applicable 
Aut 1 
Aut 2 
Man 
How helpful/disruptive were the automation concepts? 
Not helpful Rather not Rather 
at all Not helpful helpful Partly-partly helpful helpful Very helpful 
Aut 1 
Aut 2 


Would you use one of the control concepts instead of manu 


al operation? 


No, in No 


= No Rather no Neutral 
way 


Rather yes Yes 


Yes, definitely 


Auti 


Aut2 


* Manual operation was much better and much more pleasant 


Thank you for your participation in our study! 


Figure D.9: Evaluation questions of the second experiment 
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D.4.2 Results 


In the following, the results are given. Table D.3 presents the number of the hit boxes and the 
average deviation of the vehicle from its reference for the corresponding test subject. 


To test the normality condition of the data sets, Shapiro-Wilk tests were applied. The results 
are given in Table D.4, which show that the normal distribution of the data can be assumed. 
Afterwards, an F-test was applied for the results of LISC and MC. The obtained p-values for 
the comparison of LISC and MC are 


phs = 8-65-1078 and pFgs = 2.2: 107°, 


which show that the variance of LISC and MC are not the same. Therefore, a Wilcoxon Signed- 
rank test was applied to compare the objective measures of LISC with MC. The subjective 
evaluation of the controller are in Table D.4. 


Table D.3: The number of the hit boxes (Box Score) and average errors of the vehicle (dven) in the second experiment 


Nr. Test LISC NCC MC 
Box Score daygveh inm | Box Score daygven inm | Box Score davgveh in m 
1 115 0.22 71 0.07 101 0.62 
2 116 0.22 79 0.07 88 0.40 
3 111 0.23 81 0.07 65 0.80 
4 115 0.22 84 0.07 108 0.50 
5 117 0.23 76 0.07 92 0.37 
6 114 0.22 88 0.07 92 0.44 
7 117 0.24 79 0.07 119 0.28 
8 118 0.22 81 0.07 110 0.40 
9 116 0.22 80 0.07 114 0.31 
10 112 0.23 80 0.07 110 0.39 
11 114 0.19 82 0.07 93 0.44 
12 110 0.20 67 0.07 97 0.65 
13 117 0.24 83 0.07 110 0.36 
14 113 0.24 81 0.07 80 0.45 


Table D.4: Shapiro-Wilk tests of the hit boxes (Box Score) and the average errors of the vehicle (dyen) testing the 
normality condition of the data 


LISC NCC MC 
Box Score davg,ven inm | Box Score dayg veh inm | Box Score davg veh in m 


po 0.465 0.111 0.054 0.380 0.416 0.058 
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Table D.5: The results of the questions in the first experiment for the subjective assessment 


Nr. LISC NCC MC 

QI Q2 Q3 |Q1 Q2 Q3 IQI Q2 Q3 
1 6 5 6ļl4 3 312 2 7 
2 Fo ag i ae lee a A 
3 5 4 5ļ4 2 21 1 1 
4 SE (ee a a ae A A 
5 6 6 5]|2 3 se 6 7 
6 6 6 6ļ|3 4 oe |B 1ı 2 
7 6 3 6ļ|3 6 2/3 4 4 
8 7 5 5/3 7 3|5 6 7 
9 Te Fe OB |B AS BOD. 5 
TOs | Per ee RRBs cae 
11-6; “CGR 3 4/3 3 3 
12 |6 5 5/1 1 2|7 6 7 
We || toe SoS N re 2 i2 
14) YO 6 6l2 3 2|5 5 7 


D.4.3 Additional Trajectory Results 


Additional trajectories from further test subjects showing the benefits of the proposed LISC, 
see Figure D.10 and Figure D.11. 
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Reference Vehicle —MC Manipulator = LISC Manipulator = Blocks missed with MC 
—MC Vehicle = LISC Vehicle = Boxes to reach a Boxes missed with LISC 


y position in m 


40 60 80 100 120 140 
x position in m 


Figure D.10: Comparison of the trajectories test subject 6 using MC and LISC is shown. 


Reference Vehicle —MC Manipulator = LISC Manipulator = Boxes missed with MC 
—MC Vehicle = LISC Vehicle = Boxes to reach a Boxes missed with LISC 


y position in m 


100 110 120 130 140 150 160 170 180 
x position in m 


Figure D.11: Comparison of the trajectories test subject 13 using MC and LISC is shown. 
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D.5 Longitudinal Experiment 


This section presents the supplementary information for the longitudinal experiment with the 
LISC. The instructions were analogous to the the second experiment. The necessary overall 
time for finishing the task of third experiment are presented in Table D.6. Table D.7 presents the 
results of the Shapiro-Wilk test for the normality condition of LISC and NCC. The subjective 
assessments of the controllers are given in Table D.8. Additional exemplary comparisons of 
the resulting trajectories of test subject number 7 are given: Figure D.12 compares the relative 
positions ofthe manipulator and Figure D.13 compares the relative velocities ofthe manipulator 
using NCC and LISC. 


Table D.6: The overall time in s which were necessary to finish the task of the third experiment for the two runs. 


Time with LISC in s Time with NCC in s 
Test Subject Nr. | Firstrun Second run | Firstrun Second run 
1 182.66 172.74 210.70 213.99 
2 170.89 156.22 195.53 185.81 
3 166.61 157.78 211.59 198.38 
4 179.83 182.63 207.32 209.08 
5 166.11 160.12 203.98 195.58 
6 195.55 185.50 190.47 221.74 
7 174.70 177.64 219.66 205.69 
8 169.90 156.20 189.30 185.98 
9 163.53 169.06 190.88 192.53 
10 175.51 173.97 209.38 194.68 
11 213.48 184.87 214.87 225.03 
12 166.13 174.01 201.61 208.91 
13 186.69 180.05 216.43 209.28 
14 177.14 177.70 225.58 213.14 
15 171.84 156.41 201.28 198.59 


Table D.7: The p®W values of the Shapiro-Wilk test for the normality condition 


NCC LISC 
Overall time | 0.47 0.04 
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Table D.8: The subjective assessment of the experiment with the longitudinal shared control. 


LISC NCC 
Test Subject Nr. | Q1 Q2 03 | Q1 Q2 Q3 
1 7 6 6 7 7 7 
2 7 5 6 7 6 3 
3 5 6 4 5 5 4 
4 5 3 3 6 3 5 
5 6 6 6 5 3 4 
6 7 7 3 6 5 3 
7 7 7 4 7 7 7 
8 7 6 5 7 4 3 
9 7 7 6 6 5 5 
10 7 7 5 3 2 3 
11 6 6 6 4 2 4 
12 7 7 4 7 2 3 
13 5 4 5 7 7 6 
14 7 7 6 6 2 5 
15 7 5 2 7 5 3 
+ L * i 
6 otis —— LICS --- NCC 


0 10 20 30 40 50 60 70 80 


Time in s 


Figure D.12: The relative position of the manipulator with LISC (blue solid line) and with NCC (red dashed line) 
originated from the 7th test subject 
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Figure D.13: The relative longitudinal velocity of the manipulator with LISC (blue solid line) and with NCC (red 
dashed line) originated from the 7th test subject 


References 


Public References 


[ACC04] 


[ACM*18] 


[AKO06] 


[Ala12] 


[Albıs] 


[Aldo4] 


[Anc17] 


[ARTG19] 


[Ass94] 


G. Antonelli, F. Caccavale, and S. Chiaverini. Adaptive Tracking Control of 
Underwater Vehicle-Manipulator Systems Based on the Virtual Decomposition 
Approach. IEEE Transactions on Robotics and Automation, 20(3):594-602, June 
2004. 


David A. Abbink, Tom Carlson, Mark Mulder, Joost C. F. de Winter, Farzad 
Aminravan, Tricia L. Gibo, and Erwin R. Boer. A Topology of Shared Control 
Systems—Finding Common Ground in Diversity. IEEE Transactions on Human- 
Machine Systems, 48(5):509-525, October 2018. 


Sunil Agrawal, Venkat Krovi, and Marcia O’Malley. Special Issue on Novel 
Robotics and Control. Journal of Dynamic Systems, Measurement, and Control, 
128(1):1-2, March 2006. 


Juma Yousuf Alaydi. Modeling and Simulation of High-Performance Symmetri- 
cal Linear Actuator. 3(8):11, 2012. 


Dolores Albarracin. The Handbook of Attitudes, Volume 1: Basic Principles: 2nd 
Edition. Routledge, second edition, September 2018. 


Phil Alderson. Absence of evidence is not evidence of absence. BM, 
328(7438):476-477, February 2004. 


Roberto Ancona. Redundancy modelling and resolution for robotic mobile 
manipulators: A general approach. Advanced Robotics, 31(13):706-715, July 
2017. 


Vivek Annem, Pradeep Rajendran, Shantanu Thakar, and Satyandra K. Gupta. 
Towards Remote Teleoperation of a Semi-Autonomous Mobile Manipulator 
System in Machine Tending Tasks. In Volume 1: Additive Manufacturing; 
Manufacturing Equipment and Systems; Bio and Sustainable Manufacturing, 
page V001T02A027, Erie, Pennsylvania, USA, June 2019. American Society of 
Mechanical Engineers. 


World Road Association, editor. Roadside Areas and Drainage. Number 1 
in International Road Maintenance Handbook / AIPCR. Transport Research 
Laboratory, Crowthorne, 1994. 


LX 


References 


[ASTZ21] 


[AT20] 


[ATS98] 


[Av10] 


[AWN12] 


[Bac18] 


[BAH* 13] 


[Bai83] 


[BAMA20] 


[Bar11] 
[BB81] 


[BCS15] 


[Bec19] 


Ryo Arai, Satoru Sakai, Akihiro Tatsuoka, and Qin Zhang. Analytical, Experi- 
mental, and Numerical Investigation of Energy in Hydraulic Cylinder Dynamics 
of Agriculture Scale Excavators. Energies, 14(19):6210, September 2021. 


O. L. R. Albrecht and C. J. Taylor. Unknown and Time-Varying Time Delays in 
the Modelling and Control of Hydraulic Actuators: Literature Review. In 2020 
Australian and New Zealand Control Conference (ANZCC), pages 232-237, Gold 
Coast, QLD, Australia, November 2020. IEEE. 


H. Arai, K. Tanie, and N. Shiroma. Nonholonomic control of a three-DOF planar 
underactuated manipulator. IEEE Transactions on Robotics and Automation, 
14(5):681-695, Oct./1998. 


Marko Ackermann and Antonie J. van den Bogert. Optimality principles for 
model-based prediction of human gait. Journal of Biomechanics, 43(6):1055- 
1060, April 2010. 


Adeel Akhtar, Steven L. Waslander, and Christopher Nielsen. Path following for 
a quadrotor using dynamic extension and transverse feedback linearization. In 
2012 IEEE 51st IEEE Conference on Decision and Control (CDC), pages 3551-3556, 
Maui, HI, USA, December 2012. IEEE. 


Johannes Bach. Methoden und Ansätze für die Entwicklung und den Test 
prädiktiver Fahrzeugregelungsfunktionen. 2018. 


Henri Boessenkool, David A. Abbink, Cock J.M. Heemskerk, Frans C.T. van der 
Helm, and Jeroen G.W. Wildenbeest. A Task-Specific Analysis of the Benefit of 
Haptic Shared Control During Telemanipulation. IEEE Transactions on Haptics, 
6(1):2-12, 2013. 


Lisanne Bainbridge. Ironies of automation. Automatica, 19(6):775-779, Novem- 
ber 1983. 


Alexander Broad, Ian Abraham, Todd Murphey, and Brenna Argall. Data- 
driven Koopman operators for model-based shared control of human-machine 
systems. The International Journal of Robotics Research, 39(9):1178-1195, August 
2020. 


E. N Barron. Game Theory An Introduction. 2011. 


A. Bagchi and T. Basar. Stackelberg strategies in linear-quadratic stochastic 
differential games. Journal of Optimization Theory and Applications, 35(3):443- 
464, November 1981. 


Alain Bensoussan, Shaokuan Chen, and Suresh P. Sethi. The Maximum Principle 
for Global Solutions of Stochastic Stackelberg Differential Games. SIAM Journal 
on Control and Optimization, 53(4):1956-1981, January 2015. 


Niek Beckers. Haptic Human-Human Interaction: Motor Learning & Haptic 
Communication. PhD thesis, University of Twente, Enschede, The Netherlands, 
July 2019. 


References 


LXI 


[BEd* 21] 


[Ber09] 


[BGJ*05] 


[BH18] 


[BHCI20] 


[BHZ16] 


[BK16] 


[BLK*94] 


[BLR21] 


[BM15] 


[BMA17] 


[BO98] 


[BOW09] 


[BR14] 


Laura Broeker, Harald Ewolds, Rita F. de Oliveira, Stefan Kiinzell, and Markus 
Raab. The impact of predictability on dual-task performance and implications 
for resource-sharing accounts. Cognitive Research: Principles and Implications, 
6(1):1, December 2021. 


Dennis S. Bernstein. Matrix Mathematics: Theory, Facts, and Formulas. Princeton 
University Press, Princeton, NJ, 2nd ed edition, 2009. 


C. Balaguer, A. Gimenez, A. Jardon, R. Cabas, and R. Correal. Live experi- 
mentation of the service robot applications for elderly people care in home 
environments. In 2005 IEEE/RSJ International Conference on Intelligent Robots 
and Systems, pages 2345-2350, Edmonton, Alta., Canada, 2005. IEEE. 


Arthur E Bryson and Yu-Chi Ho. Applied Optimal Control: Optimization, Esti- 
mation, and Control. Routledge, 2018. 


Simon Birrell, Josie Hughes, Julia Y. Cai, and Fumiya lida. A field-tested robotic 
harvesting system for iceberg lettuce. Journal of Field Robotics, 37(2):225-245, 
March 2020. 


Tamer Basar, Alain Haurie, and Georges Zaccour. Nonzero-Sum Differential 
Games. In Tamer Basar and Georges Zaccour, editors, Handbook of Dynamic 
Game Theory, pages 1-49. Springer International Publishing, Cham, 2016. 


Bruno Siciliano and Oussama Khatib. Springer Handbook of Robotics. Springer 
Berlin Heidelberg, New York, NY, 2nd edition edition, 2016. 


David A Bell, Simon P Levine, Yoram Koren, Lincoln A Jaros, and Johann 
Borenstein. Design criteria for obstacle avoidance in a shared-control system. 
In RESNA, volume 94, pages 581-583, 1994. 


F. Bünger, M. Lange, and S.M. Rump. On norms of principal submatrices. Linear 
Algebra and its Applications, 620:27-36, July 2021. 


Behzad Bashiri and Danny D Mann. Impact of automation on drivers’ perfor- 
mance in agricultural semi-autonomous vehicles. Journal of agricultural safety 
and health, 21(2):129-139, 2015. 


Alexander Broad, Todd Murphey, and Brenna Argall. Learning Models for 
Shared Control of Human-Machine Systems with Unknown Dynamics. In 
Robotics: Science and Systems XIII. Robotics: Science and Systems Foundation, 
July 2017. 


Tamer Basar and Geert Jan Olsder. Dynamic Noncooperative Game Theory, 2nd 
Edition. Society for Industrial and Applied Mathematics, January 1998. 


Daniel A. Braun, Pedro A. Ortega, and Daniel M. Wolpert. Nash Equilibria in 
Multi-Agent Motor Interactions. PLoS Computational Biology, 5(8):e1000468, 
August 2009. 


Sudipto Banerjee and Anindya Roy. Linear Algebra and Matrix Analysis for 
Statistics. Chapman and Hall/CRC, zeroth edition, June 2014. 


LXII 


References 


[Bra14] 


[Bru22] 


[Bun21] 


[BYM22] 


[Cal22] 


[CB97] 


[CCL10] 


[CCS*18] 


[CGA04] 


[CKH08] 


[CL89] 


[CODP98] 


[COP 10] 


Siegmund Brandt. Data Analysis. Springer International Publishing, Cham, 
2014. 


Brunner. Brunner Elektronik AG. https://www.brunner- 
innovation.swiss/product/brunner-jet/, 2022. 


Bundesministerium fiir Verkehr und digitale Infrastruktur. Gesetzes zur An- 
derung des Straßenverkehrsgesetzes und des Pflichtversicherungsgesetzes - 
Gesetz zum autonomen Fahren, 2021. 


Maulik Bhatt, Ayberk Yaraneri, and Negar Mehr. Efficient Constrained Multi- 
Agent Interactive Planning using Constrained Dynamic Potential Games. 2022. 


Aaron R Caldwell. Exploring equivalence testing with the updated TOSTER R 
package. PsyArXiv, 2022. 


Jonathan M. Cameron and Wayne J. Book. Modeling Mechanisms with Non- 
holonomic Joints Using the Boltzmann-Hamel Equations. The International 
Journal of Robotics Research, 16(1):47-59, February 1997. 


Sachin Chitta, Benjamin Cohen, and Maxim Likhachev. Planning for au- 
tonomous door opening with a mobile manipulator. In 2010 IEEE International 
Conference on Robotics and Automation, pages 1799-1806, Anchorage, AK, May 
2010. IEEE. 


Yunlong Cai, Fangyu Cui, Qingjiang Shi, Minjian Zhao, and Geoffrey Ye Li. 
Dual-UAV-Enabled Secure Communications: Joint Trajectory Design and User 
Scheduling. IEEE Journal on Selected Areas in Communications, 36(9):1972-1985, 
September 2018. 


Robert A Cribbie, Jamie A Gruman, and Chantal A Arpin-Cribbie. Recom- 
mendations for applying tests of equivalence. Journal of clinical psychology, 
60(1):1-10, 2004. 


Baek-Suk Chu, Dong-Nam Kim, and Dae-Hie Hong. Robotic automation tech- 
nologies in construction: A review. International Journal of Precision Engineering 
and Manufacturing, 9(3):85-91, 2008. 


Mihaly Csikszentmihalyi and Judith LeFevre. Optimal experience in work and 
leisure. Journal of Personality and Social Psychology, 56(5):815-822, 1989. 


C. Canudas de Wit, E. Olguin Diaz, and M. Perrier. Robust nonlinear control 
of an underwater vehicle/manipulator system with composite dynamics. In 
Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. 
No.98CH36 146), volume 1, pages 452-457, Leuven, Belgium, 1998. IEEE. 


Ozan Candogan, Asuman Ozdaglar, and Pablo A. Parrilo. A projection frame- 
work for near-potential games. In 49th IEEE Conference on Decision and Control 
(CDC), pages 244-249, Atlanta, GA, USA, December 2010. IEEE. 


References 


LXII 


[COP13] 


[CPO06] 


[Csi75] 


[CVH98] 


[Dal08] 


[DDT*22] 


[Deu22] 


[DHQS08] 


[DHZ06] 


[DKK*17] 


[DLLP09] 


[DLYL*20] 


[DMI03] 


Ozan Candogan, Asuman Ozdaglar, and Pablo A. Parrilo. Near-Potential Games: 
Geometry and Dynamics. ACM Transactions on Economics and Computation, 
1(2):1-32, May 2013. 


D. J. Cole, A. J. Pick, and A. M. C. Odhams. Predictive and linear quadratic 
methods for potential application to modelling driver steering control. Vehicle 
System Dynamics, 44(3):259-284, March 2006. 


Mihaly Csikszentmihalyi. Beyond Boredom and Anxiety. The Jossey-Bass 
Behavioral Science Series. Jossey-Bass Publishers, San Francisco, 1st ed edition, 
1975. 


Jae H. Chung, Steven A. Velinsky, and Ronald A. Hess. Interaction Control of a 
Redundant Mobile Manipulator. The International Journal of Robotics Research, 
17(12):1302-1309, December 1998. 


Peter Dalgaard. Introductory Statistics with R. Statistics and Computing. Springer 
New York, New York, NY, 2008. 


Leonidas Droukas, Zoe Doulgeri, Nikolaos L. Tsakiridis, Dimitra Triantafyllou, 
Ioannis Kleitsiotis, Ioannis Mariolis, Dimitrios Giakoumis, Dimitrios Tzovaras, 
Dimitrios Kateris, and Dionysis Bochtis. A Survey of Robotic Harvesting 
Systems and Enabling Technologies. 2022. 


Deutsches Zentrum fiir Luft- und Raumfahrt e.V. Verkehr in Zahlen 2021/2022. 
2022. 


Jacques Durieu, Hans Haller, Nicolas Querou, and Philippe Solal. Ordinal 
Games. International Game Theory Review, 10(02):177-194, June 2008. 


Pradeep Dubey, Ori Haimanko, and Andriy Zapechelnyuk. Strategic comple- 
ments and substitutes, and potential games. Games and Economic Behavior, 
54(1):77-94, January 2006. 


Andreas Dömel, Simon Kriegel, Michael Kaßecker, Manuel Brucker, Tim Bo- 
denmiiller, and Michael Suppa. Toward fully autonomous mobile manipulation 
for industrial environments. International Journal of Advanced Robotic Systems, 
14(4):172988141771858, July 2017. 


Davide Dragone, Luca Lambertini, George Leitmann, and Arsen Palestini. 
Hamiltonian Potential Functions for Differential Games. IFAC Proceedings 
Volumes, 42(2):1-8, 2009. 


Xiaoyan Deng, Zhu Liang Yu, Canguang Lin, Zhenghui Gu, and Yuanqing Li. 
Self-adaptive shared control with brain state evaluation network for human- 
wheelchair cooperation. Journal of Neural Engineering, 17(4):045005, July 2020. 


Yadolah Dodge, F. H. C. Marriott, and International Statistical Institute, editors. 
The Oxford Dictionary of Statistical Terms. Oxford University Press, Oxford ; 
New York, 6th ed edition, 2003. 


LXIV 


References 


[DP14] 


[DPCB19] 


[DS13] 


[Due20] 
[DV89] 


[DYM*22] 


[EB10a] 


[EB10b] 


[EB11] 


[EB21] 


[Ege91] 


[EH13] 


Velin Dimitrov and Taskin Padir. A shared control architecture for human-in- 
the-loop robotics applications. In The 23rd IEEE International Symposium on 
Robot and Human Interactive Communication, pages 1089-1094, Edinburgh, UK, 
August 2014. IEEE. 


Louise Devigne, Francois Pasteau, Tom Carlson, and Marie Babel. A shared con- 
trol solution for safe assisted power wheelchair navigation in an environment 
consisting of negative obstacles: A proof of concept. In 2019 IEEE International 
Conference on Systems, Man and Cybernetics (SMC), pages 1043-1048, Bari, Italy, 
October 2019. IEEE. 


Anca D Dragan and Siddhartha S Srinivasa. A policy-blending formalism for 
shared control. The International Journal of Robotics Research, 32(7):790-805, 
June 2013. 


Duecker. Prospekt: Ausleger, April 2020. 


S. Dubowsky and E.E. Vance. Planning mobile manipulator motions consid- 
ering vehicle dynamic stability constraints. In Proceedings, 1989 International 
Conference on Robotics and Automation, pages 1271-1276, Scottsdale, AZ, USA, 
1989. IEEE Comput. Soc. Press. 


Neel Dhanaraj, Yeo Jung Yoon, Rishi Malhan, Prahar M. Bhatt, Shantanu Thakar, 
and Satyandra K. Gupta. A Mobile Manipulator System for Accurate and 
Efficient Spraying on Large Surfaces. Procedia Computer Science, 200:1528-1539, 
2022. 


Aaron Enes and Wayne Book. Blended Shared Control of Zermelo’s navigation 
problem. In Proceedings of the 2010 American Control Conference, pages 4307- 
4312, Baltimore, MD, June 2010. IEEE. 


Aaron R. Enes and Wayne J. Book. Optimizing point to point motion of net 
velocity constrained manipulators. In 49th IEEE Conference on Decision and 
Control (CDC), pages 6415-6420, Atlanta, GA, USA, December 2010. IEEE. 


Mark D. Elton and Wayne J. Book. Comparison of human-machine interfaces 
designed for novices teleoperating multi-DOF hydraulic manipulators. In 2011 
RO-MAN, pages 395-400, Atlanta, GA, USA, July 2011. IEEE. 


Shirin Esmaeili Bijarsari. A Current View on Dual-Task Paradigms and Their 
Limitations to Capture Cognitive Load. Frontiers in Psychology, 12:648586, May 
2021. 


Olav Egeland. The Norwegian research programme on advanced robotic sys- 
tems. Modeling, Identification and Control: A Norwegian Research Bulletin, 
12(2):57-67, 1991. 


Paul Embrechts and Marius Hofert. A note on generalized inverses. Mathemat- 
ical Methods of Operations Research, 77(3):423-432, June 2013. 


References 


LXV 


[Ene10] 


[Eng98] 


[Eng05] 


[ER19] 


[ESP21a] 


[ESP21b] 


[ETKA*19] 


[Ewe20] 


[FAD10] 


[FAI* 16] 


[FAI*19] 


Aaron R Enes. Shared Control of Hydraulic Manipulators to Decrease Cycle Time. 
PhD thesis, School of Mechanical Engineering, Georgia Institute of Technology, 
2010. 


Jacob Engwerda. On the open-loop Nash equilibrium in LQ-games. Other 
publications TiSEM, Tilburg University, School of Economics and Management, 
1998. 


Jacob Engwerda. LQ Dynamic Optimization and Differential Games. Tilburg 
university, the netherlands edition, 2005. 


Haitham El-Hussieny and Jee-Hwan Ryu. Inverse discounted-based LQR algo- 
rithm for learning human movement behaviors. Applied Intelligence, 49(4):1489- 
1501, April 2019. 


Stefan Engeser, Anja Schiepe-Tiska, and Corinna Peifer. Historical lines and an 
overview of current research on flow. Advances in flow research, pages 1-29, 
2021. 


Brecht Evens, Mathijs Schuurmans, and Panagiotis Patrinos. Learning MPC 
for Interaction-Aware Autonomous Driving: A Game-Theoretic Approach. 
arXiv:2111.08331 [math], November 2021. 


Mehran Eskandari Torbaghan, Bilal Kaddouh, Mohamed Abdellatif, Nicole 
Metje, Jason Liu, Richard Jackson, Christopher D F Rogers, David N Chapman, 
Raul Fuentes, Mark Miodownik, Robert Richardson, and Phil Purnell. Robotic 
and autonomous systems for road asset management: A position paper. Proceed- 
ings of the Institution of Civil Engineers - Smart Infrastructure and Construction, 
172(2):83-93, June 2019. 


Christian Ewerhart. Ordinal potentials in smooth games. Economic Theory, 
70(4):1069-1100, November 2020. 


F Farelo, R Alqasemi, and R Dubey. Optimized dual-trajectory tracking control 
of a 9-DoF WMRA system for ADL tasks. In 2010 IEEE International Conference 
on Robotics and Automation, pages 1786-1791, Anchorage, AK, May 2010. IEEE. 


F. Flemisch, D. Abbink, M. Itoh, M-P. Pacaux-Lemoine, and G. Weßel. Shared 
control is the sharp end of cooperation: Towards a common framework of joint 
action, shared control and human machine cooperation. IEAC-PapersOnLine, 
49(19):72-77, 2016. 


F. Flemisch, D. A. Abbink, M. Itoh, M.-P. Pacaux-Lemoine, and G. Weßel. Joining 
the blunt and the pointy end of the spear: Towards a common framework of joint 
action, human-machine cooperation, cooperative guidance and control, shared, 
traded and supervisory control. Cognition, Technology & Work, 21(4):555-568, 
November 2019. 


LXVI 


References 


[FDGS09] 


[FDP* 10] 


[FFH17] 


[FFV16] 


[FG20] 


[FGP14] 


[FH15] 
[FH18] 
[Fie20] 


[Fla16] 


[For06] 


[For16] 
[FOSH14a] 


Pal J. From, Vincent Duindam, Jan T. Gravdahl, and Shankar Sastry. Modeling 
and motion planning for mechanisms on a non-inertial base. In 2009 IEEE 
International Conference on Robotics and Automation, pages 3320-3326, Kobe, 
May 2009. IEEE. 


Pål J. From, Vincent Duindam, Kristin Y. Pettersen, Jan T. Gravdahl, and Shankar 
Sastry. Singularity-free dynamic equations of vehicle-manipulator systems. 
Simulation Modelling Practice and Theory, 18(6):712-731, June 2010. 


Michael Flad, Lukas Frohlich, and Soren Hohmann. Cooperative Shared Control 
Driver Assistance Systems Based on Motion Primitives and Differential Games. 
IEEE Transactions on Human-Machine Systems, 47(5):711-722, October 2017. 


Mr Szabolcs Fodor, Dr Leonid Freidovich, and Dr Carlos Vazquez. Practical 
trajectory designs for semi-automation of forestry cranes. page 8, 2016. 


Filippo Fabiani and Sergio Grammatico. Multi-Vehicle Automated Driving as 
a Generalized Mixed-Integer Potential Game. IEEE Transactions on Intelligent 
Transportation Systems, 21(3):1064-1073, March 2020. 


Pal Johan From, Jan Tommy Gravdahl, and Kristin Ytterstad Pettersen. Vehicle- 
Manipulator Systems: Modeling for Simulation, Analysis, and Control. Advances 
in Industrial Control. Springer London, London, 2014. 


Dietmar Findeisen and Siegfried Helduser. Olhydraulik. Springer Berlin Heidel- 
berg, Berlin, Heidelberg, 2015. 


Alejandra Fonseca-Morales and Onésimo Hernandez-Lerma. Potential Differ- 
ential Games. Dynamic Games and Applications, 8(2):254-279, June 2018. 


Fiedler. Produktkatalog, April 2020. 


Michael Flad. Kooperative Regelungskonzepte auf Basis der Spieltheorie und 
deren Anwendung auf Fahrerassistenzsysteme. PhD thesis, Institute of Control 
Systems, Karlsruhe Institute of Technologie, 2016. 


Forschungsgesellschaft fiir Strassen- und Verkehrswesen, editor. Merkblatt fir 
den Straßenbetriebsdienst. Teil: Grünpflege / Forschungsgesellschaft für Straßen- 
und Verkehrswesen, Arbeitsgruppe Verkehrsführung und Verkehrssicherheit, [Ar- 
beitsausschuss: Straßenunterhaltung, Straßenbetrieb und Winterdienst, Arbeit- 
skreis: Unterhaltungs- und Betriebsdienst]. Number 390,1 in FGSV. FGSV Verl, 
Köln, ausg. 2006 edition, 2006. 


Otto Forster. Analysis 1. Springer Fachmedien Wiesbaden, Wiesbaden, 2016. 


Michael Flad, Jonas Otten, Stefan Schwab, and Soren Hohmann. Necessary 
and sufficient conditions for the design of cooperative shared control. In 2014 
IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 
1253-1259, San Diego, CA, USA, October 2014. IEEE. 


References 


LXVII 


[FOSH14b] 


[FP21] 


[Fra04] 


[FTCZ10] 


[FVF15] 


[FVF16] 


[GB21] 


[GBGKH18] 


[GF12] 


[GG05] 


[GH16] 


[Gil69] 


Michael Flad, Jonas Otten, Stefan Schwab, and Soren Hohmann. Steering driver 
assistance system: A systematic cooperative shared control design approach. 
In 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 
pages 3585-3592, San Diego, CA, USA, October 2014. IEEE. 


Mike Fensterseifer and Jürgen Porwollik. Leistungsheft für den Straßenbe- 
trieb auf Bundesfernstraßen, Betriebskostenrechnung im Straßenbetriebsdienst. 
page 97, 2021. 


Joe Frankel. Development of a Haptic Backhoe Testbed. Master’s thesis, School 
of Mechanical Engineering, Georgia Institute of Technology, 2004. 


Feng Han, Tao Xu, Chaoping Tian, and Zhenjie Hou. Investigation on human 
visual response latency. In 2010 International Conference On Computer Design 
and Applications, pages V1-602-V1-604, Qinhuangdao, China, June 2010. IEEE. 


Szabolcs Fodor, Carlos Vazquez, and Leonid Freidovich. Automation of slewing 
motions for forestry cranes. In 2015 15th International Conference on Control, 
Automation and Systems (ICCAS), pages 796-801, Busan, Korea (South), October 
2015. IEEE. 


Szabolcs Fodor, Carlos Vazquez, and Leonid Freidovich. Interactive on-line 
trajectories for semi-automation: Case study of a forwarder crane. In 2016 IEEE 
International Conference on Automation Science and Engineering (CASE), pages 
928-933, Fort Worth, TX, USA, August 2016. IEEE. 


Ibrahim Can Güleryüz and Özgün Baser. Modelling the longitudinal braking 
dynamics for heavy-duty vehicles. Proceedings of the Institution of Mechanical 
Engineers, Part D: Journal of Automobile Engineering, 235(10-11):2802-2817, 
September 2021. 


Hakim Ghazzai, Mahdi Ben Ghorbel, Andreas Kassler, and Md. Jahangir Hossain. 
Trajectory Optimization for Cooperative Dual-Band UAV Swarms. In 2018 IEEE 
Global Communications Conference (GLOBECOM), pages 1-7, Abu Dhabi, United 
Arab Emirates, December 2018. IEEE. 


Jorge Gomez Fernandez. A vehicle dynamics model for driving simulators. 
Department of Applied Mechanics, Chalmers University of Technology, Goteborg, 
page 115, 2012. 


Paul G. Griffiths and R. Brent Gillespie. Sharing Control Between Humans and 
Automation Using Haptic Interface: Primary and Secondary Task Performance 
Benefits. Human Factors: The Journal of the Human Factors and Ergonomics 
Society, 47(3):574-590, September 2005. 


David Gonzalez-Sanchez and Onésimo Hernändez-Lerma. A survey of static 
and dynamic potential games. Science China Mathematics, 59(11):2075-2102, 
November 2016. 


Elmer G Gilbert. The decoupling of multivariable systems by state feedback. 
SIAM Journal on Control, 7(1):50-63, 1969. 


LXVIII 


References 


[GJ*10] 
[GJA17] 


[GLM02] 


[GLWL20] 


[Gmb16] 


[GWYZ19] 


[HA84] 


[HA 12] 


[Hap92] 


[HB16] 


[HD91a] 


[HD91b] 


[Heg08] 


Gaél Guennebaud, Benoit Jacob, et al. Eigen v3, 2010. 


Deepak Gopinath, Siddarth Jain, and Brenna D. Argall. Human-in-the-Loop 
Optimization of Shared Autonomy in Assistive Robotics. IEEE Robotics and 
Automation Letters, 2(1):247-254, January 2017. 


Jeffrey A. Gliner, Nancy L. Leech, and George A. Morgan. Problems With Null 
Hypothesis Significance Testing (NHST): What Do the Textbooks Say? The 
Journal of Experimental Education, 71(1):83-92, January 2002. 


Mengdi Gao, Lei Li, Qingyang Wang, and Conghu Liu. Energy Efficiency and 
Dynamic Analysis of a Novel Hydraulic System with Double Actuator. Inter- 
national Journal of Precision Engineering and Manufacturing-Green Technology, 
7(3):643-655, May 2020. 


BSL Managementberatung GmbH. Organisations- und Wirtschaftlichkeitsun- 
tersuchung in der Straßenbauverwaltung Baden-Württemberg, 2016. 


Daoxiong Gong, Yu Wang, Jianjun Yu, and Guoyu Zuo. Motion Mapping from 
a Human Arm to a Heterogeneous Excavator-like Robotic Arm for Intuitive 
Teleoperation. In 2019 IEEE International Conference on Real-time Computing 
and Robotics (RCAR), pages 493-498, Irkutsk, Russia, August 2019. IEEE. 


Walter W. Hauck and Sharon Anderson. A new statistical procedure for test- 
ing equivalence in two-group comparative bioavailability trials. Journal of 
Pharmacokinetics and Biopharmaceutics, 12(1):83-91, February 1984. 


Triet Hung Ho and Kyoung Kwan Ahn. Design and control of a closed-loop 
hydraulic energy-regenerative system. Automation in construction, 22:444-458, 
2012. 


R. Happee. Time optimality in the control of human movements. Biological 
Cybernetics, 66(4):357-366, February 1992. 


Erich Hoepke and Stefan Breuer, editors. Nutzfahrzeugtechnik. Springer Fachme- 
dien Wiesbaden, Wiesbaden, 2016. 


N.A.M. Hootsmans and S. Dubowsky. Large motion control of mobile ma- 
nipulators including vehicle suspension characteristics. In Proceedings. 1991 
IEEE International Conference on Robotics and Automation, pages 2336-2341, 
Sacramento, CA, USA, 1991. IEEE Comput. Soc. Press. 


Norbert A. M. Hootsmans and Steven Dubowsky. Control of mobile manipula- 
tors including vehicle dynamic characteristics. In Proc. IV Topical Meeting on 
Robotics and Remote Systems, pages 24-28, 1991. 


J Hegde. Time course of visual perception: Coarse-to-fine processing and 
beyond. Progress in Neurobiology, 84(4):405-439, April 2008. 


References 


LXIX 


[HGC* 14] 


[Hil16] 


[HJo6] 


[HJ17] 


[HKR15] 


[HKZ12] 


[HMV19] 


[HOD*22] 


[Hör21] 


[Hsss] 


[HS10] 


[HS19] 


[HTS00] 


[Hya11] 


Kelsey P. Hawkins, Phillip M. Grice, Tiffany L. Chen, Chih-Hung King, and 
Charles C. Kemp. Assistive mobile manipulation for self-care tasks around 
the head. In 2014 IEEE Symposium on Computational Intelligence in Robotic 
Rehabilitation and Assistive Technologies (CIR2AT), pages 16-25, Orlando, FL, 
USA, December 2014. IEEE. 


Michael Hilgers. Dieselmotor. Springer Fachmedien Wiesbaden, Wiesbaden, 
2016. 


Kimura Hidenori and Yifa Jiang. A PID model of human balance keeping. IEEE 
Control Systems Magazine, 26(6):18-23, 2006. 


Roger A. Horn and Charles R. Johnson. Matrix Analysis. Cambridge University 
Press, New York, NY, second edition, corrected reprint edition, 2017. 


Wolfgang Karl Härdle, Sigbert Klinke, and Bernd Rönz. Introduction to Statistics. 
Springer International Publishing, Cham, 2015. 


Alain Haurie, Jacek B Krawczyk, and Georges Zaccour. Games and Dynamic 
Games, volume 1. World Scientific Publishing Company, 2012. 


Ophelie Herve, Anne Martin, and Dario J. Villarreal. A PID Controller Approach 
to Explain Human Ankle Biomechanics across Walking Speeds. In 2019 41st 
Annual International Conference of the IEEE Engineering in Medicine and Biology 
Society (EMBC), pages 2420-2423, Berlin, Germany, July 2019. IEEE. 


Valentin N. Hartmann, Andreas Orthey, Danny Driess, Ozgur S. Oguz, and 
Marc Toussaint. Long-Horizon Multi-Robot Rearrangement Planning for Con- 
struction Assembly. IEEE Transactions on Robotics, pages 1-14, 2022. 


Stefan Hörold. Leistungsbezogene Musterjahresganglinien für den Straßenbe- 
triebsdienst. Thesis, Bauhaus-Universität Weimar, 2021. 


Sandra G Hart and Lowell E Staveland. Development of NASA-TLX (task load 
index): Results of empirical and theoretical research. In Advances in Psychology, 
volume 52, pages 139-183. Elsevier, 1988. 


A. Hansson and M. Servin. Semi-autonomous shared control of large-scale 
manipulator arms. Control Engineering Practice, 18(9):1069-1076, September 
2010. 


Kristöf Hödsägi and György Szabö. Bursts in three-strategy evolutionary 
ordinal potential games on a square lattice. Physica A: Statistical Mechanics and 
its Applications, 525:1379-1387, July 2019. 


Qiang Huang, Kazuo Tanie, and Shigeki Sugano. Coordinated Motion Plan- 
ning for a Mobile Manipulator considering Stability and Manipulation. The 
International Journal of Robotics Research, 19(8):732-742, August 2000. 


Tadahiro Hyakudome. Design of Autonomous Underwater Vehicle. Interna- 
tional Journal of Advanced Robotic Systems, 8(1):9, March 2011. 


LXX 


References 


[HZL* 20] 


[IBM* 19] 


(1C21] 


[ICH21] 


[IEFH18] 


[Jef10] 


[JKL*19] 


[JPHK14] 


[JPMC18] 


[JYN*19] 


[KB03] 


[KBV14] 


Da Hu, Hai Zhong, Shuai Li, Jindong Tan, and Qiang He. Segmenting areas of 
potential contamination for adaptive robotic disinfection in built environments. 
Building and Environment, 184:107226, October 2020. 


Jairo Inga, Esther Bischoff, Timothy L. Molloy, Michael Flad, and Soren 
Hohmann. Solution Sets for Inverse Non-Cooperative Linear-Quadratic Differ- 
ential Games. IEEE Control Systems Letters, 3(4):871-876, October 2019. 


Juan Jairo Inga Charaja. Inverse Dynamic Game Methods for Identification of 
Cooperative System Behavior. Thesis, KIT Scientific Publishing / Karlsruher 
Institut für Technologie (KIT), 2021. 


Jairo Inga, Andreas Creutz, and Soren Hohmann. Online Inverse Linear- 
Quadratic Differential Games Applied to Human Behavior Identification in 
Shared Control. In 2021 European Control Conference (ECC), pages 353-360, 
Delft, Netherlands, June 2021. IEEE. 


Jairo Inga, Michael Eitel, Michael Flad, and Soren Hohmann. Evaluating Human 
Behavior in Manual and Shared Control via Inverse Optimization. In 2018 IEEE 
International Conference on Systems, Man, and Cybernetics (SMC), pages 2699- 
2704, Miyazaki, Japan, October 2018. IEEE. 


Charles Jeffrey. An Introduction to GNSS: GPS, GLONASS, Galileo and Other 
Global Navigation Satellite Systems. NovAtel, Calgary, 1st ed edition, 2010. 


Wanxin Jin, Dana Kulic, Jonathan Feng-Shun Lin, Shaoshuai Mou, and San- 
dra Hirche. Inverse Optimal Control for Multiphase Cost Functions. IEEE 
Transactions on Robotics, 35(6):1387-1398, December 2019. 


Markus Janczyk, Roland Pfister, Bernhard Hommel, and Wilfried Kunde. Who 
is talking in backward crosstalk? Disentangling response- from goal-conflict in 
dual-task performance. Cognition, 132(1):30-43, July 2014. 


Zongyao Jin, Prabhakar Pagilla, Harshal Maske, and Girish Chowdhary. Blended 
Shared Control with Subgoal Adjustment. In 2018 IEEE International Conference 
on Systems, Man, and Cybernetics (SMC), pages 2724-2729, Miyazaki, Japan, 
October 2018. IEEE. 


Xuewu Ji, Kaiming Yang, Xiaoxiang Na, Chen Lv, and Yahui Liu. Shared Steering 
Torque Control for Lane Change Assistance: A Stochastic Game-Theoretic 
Approach. IEEE Transactions on Industrial Electronics, 66(4):3093-3105, April 
2019. 


Matthew E. Konz and Wayne J. Book. Position/Rate Haptic Control of a Hy- 
draulic Forklift. In Dynamic Systems and Control, Volumes 1 and 2, pages 
801-808, Washington, DC, USA, January 2003. ASMEDC. 


Jouko Kalmari, Juha Backman, and Arto Visala. Nonlinear model predictive 
control of hydraulic forestry crane with automatic sway damping. Computers 
and Electronics in Agriculture, 109:36-45, November 2014. 


References 


LXXI 


[KBV17] 


[KCF* 12] 


[KECM22] 


[Kha02] 


[Kha15] 


[KHS* 14] 


[KKL*09] 


[KKP*09] 


[KKW*21] 


[KLPK07] 


[KMAM18] 


[KMPK21] 


Jouko Kalmari, Juha Backman, and Arto Visala. Coordinated motion of a 
hydraulic forestry crane and a vehicle using nonlinear model predictive control. 
Computers and Electronics in Agriculture, 133:119-127, February 2017. 


Chih-Hung King, Tiffany L. Chen, Zhengqin Fan, Jonathan D. Glass, and 
Charles C. Kemp. Dusty: An assistive mobile manipulator that retrieves dropped 
objects for people with motor impairments. Disability and Rehabilitation: As- 
sistive Technology, 7(2):168-179, March 2012. 


Charles C. Kemp, Aaron Edsinger, Henry M. Clever, and Blaine Matulevich. 
The Design of Stretch: A Compact, Lightweight Mobile Manipulator for In- 
door Human Environments. In 2022 International Conference on Robotics and 
Automation (ICRA), pages 3150-3157, Philadelphia, PA, USA, May 2022. IEEE. 


Hassan K. Khalil. Nonlinear Systems. Prentice Hall, Upper Saddle River, N.J, 3rd 
ed edition, 2002. 


Hassan K. Khalil. Nonlinear Control. Pearson, Boston, 2015. 


K. Kondak, F. Huber, M. Schwarzbach, M. Laiacker, D. Sommer, M. Bejar, and 
A. Ollero. Aerial manipulation robot composed of an autonomous helicopter 
and a 7 degrees of freedom industrial manipulator. In 2014 IEEE International 
Conference on Robotics and Automation (ICRA), pages 2107-2112, Hong Kong, 
China, May 2014. IEEE. 


Dongmok Kim, Jongwon Kim, Kyouhee Lee, Cheolgyu Park, Jinsuk Song, and 
Deuksoo Kang. Excavator tele-operation system using a human arm. Automa- 
tion in Construction, 18(2):173-182, March 2009. 


Minseong Kim, Suntae Kim, Sooyong Park, Mun-Taek Choi, Munsang Kim, 
and Hassan Gomaa. Service robot for the elderly. IEEE Robotics & Automation 
Magazine, 16(1):34-45, March 2009. 


Emek Baris Kügüktabak, Sangjoon J. Kim, Yue Wen, Kevin Lynch, and Jose L. 
Pons. Human-machine-human interaction in motor control and rehabilitation: 
A review. journal of NeuroEngineering and Rehabilitation, 18(1):183, December 
2021. 


Wilfried Kunde, Franziska Landgraf, Marko Paelecke, and Andrea Kiesel. Dorsal 
and Ventral Processing Under Dual-Task Conditions. Psychological Science, 
18(2):100-104, February 2007. 


Niki Kousi, George Michalos, Sotirios Aivaliotis, and Sotiris Makris. An outlook 
on future assembly systems introducing robotic mobile dual arm workers. 
Procedia CIRP, 72:33-38, 2018. 


Wolfgang Kemmetmüller, Martin Meiringer, Valentin Platzgummer, and An- 
dreas Kugi. Optimale Abstützung eines mobilen Großraummanipulators. at - 
Automatisierungstechnik, 69(9):782-794, September 2021. 


LXXII 


References 


[KNH14] 


[Kom08] 


[Kön22] 


[KR15] 


[KSWK20] 


[KTFH20] 


[Kuk99] 


[KVML18] 


[KYM21] 


[KZM19] 


[Lak17] 


[LC97] 


Roland L. Kovacs, Laszlo Nadai, and Zoltan Hankovszki. Modeling of commer- 
cial vehicles for vehicle dynamics control development. In 2014 IEEE 9th IEEE 
International Symposium on Applied Computational Intelligence and Informatics 
(SACI), pages 305-310, Timisoara, Romania, May 2014. IEEE. 


Klaus Kompaß. Fahrerassistenzsysteme der Zukunft-auf dem Weg zum au- 
tonomen Pkw. Forschung für das Auto von Morgen: Aus Tradition entsteht 
Zukunft, pages 261-285, 2008. 


Alexander König. Absicherung hochautomatisierten Fahrens durch passiven 
virtuellen Dauerlauftest. Number Band 14 in Karlsruher Beiträge zur Regelungs- 
und Steuerungstechnik. KIT Scientific Publishing, Karlsruhe, 2022. 


Thomas Kämpke and Franz Josef Radermacher. The Generalized Inverse of Dis- 
tribution Functions, volume 679, pages 9-28. Springer International Publishing, 
Cham, 2015. 


Hirokazu Konishi, Norimitsu Sakagami, Takahiro Wada, and Sadao Kawamura. 
Haptic Shared Control for Path Tracking Tasks of Underwater Vehicles. In 2020 
IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 
4424-4430, Toronto, ON, Canada, October 2020. IEEE. 


Florian Köpf, Samuel Tesfazgi, Michael Flad, and Sören Hohmann. Deep Decen- 
tralized Reinforcement Learning for Cooperative Control. IFAC-PapersOnLine, 
53(2):1555-1562, 2020. 


Nikolai S. Kukushkin. Potential games: A purely ordinal approach. Economics 
Letters, 64(3):279-283, September 1999. 


Bahare Kiumarsi, Kyriakos G. Vamvoudakis, Hamidreza Modares, and Frank L. 
Lewis. Optimal and Autonomous Control Using Reinforcement Learning: A 
Survey. IEEE Transactions on Neural Networks and Learning Systems, 29(6):2042- 
2062, June 2018. 


Talha Kavuncu, Ayberk Yaraneri, and Negar Mehr. Potential iLQR: A Potential- 
Minimizing Controller for Planning Multi-Agent Interactive Trajectories. In 
Robotics: Science and Systems XVI. Robotics: Science and Systems Foundation, 
July 2021. 


Janne Koivumäki, Wen-Hong Zhu, and Jouni Mattila. Energy-efficient and high- 
precision control of hydraulic robots. Control Engineering Practice, 85:176-193, 
April 2019. 


Daniël Lakens. Equivalence Tests: A Practical Primer for t Tests, Correlations, 
and Meta-Analyses. Social Psychological and Personality Science, 8(4):355-362, 
May 2017. 


Jen-pei Liu and Shein-Chung Chow. A two one-sided tests procedure for 
assessment of individual bioequivalence. Journal of Biopharmaceutical Statistics, 
7(1):49-61, January 1997. 


References 


LXXIII 


[LCS16] 


[LH05] 


[LHCY19] 


[LHMWS09] 


[LHOM15] 


[Lik32] 


[LL90] 


[LL11] 


[LL15] 


[LMT13] 


[LNM20] 


[Log22] 
[Loh91] 


[LP17] 


Quang Duy Lä, Yong Huat Chew, and Boon-Hee Soong. Potential Game Theory. 
Springer International Publishing, Cham, 2016. 


Xiao-Yun Lu and J. Karl Hedrick. Heavy-duty vehicle modelling and longitudinal 
control. Vehicle System Dynamics, 43(9):653-669, September 2005. 


Jianfeng Liao, Fanghao Huang, Zheng Chen, and Bin Yao. Optimization-based 
motion planning of mobile manipulator with high degree of kinematic redun- 
dancy. International Journal of Intelligent Robotics and Applications, 3(2):115-130, 
June 2019. 


P.M. La Hera, U. Mettin, S. Westerberg, and A.S. Shiriaev. Modeling and control 
of hydraulic rotary actuators used in forestry cranes. In 2009 IEEE International 
Conference on Robotics and Automation, pages 1315-1320, Kobe, May 2009. IEEE. 


Pedro La Hera and Daniel Ortiz Morales. Model-Based Development of Control 
Systems for Forestry Cranes. Journal of Control Science and Engineering, 2015:1- 
15, 2015. 


Rensis Likert. A technique for the measurement of attitudes. Archives of 
psychology, 1932. 


K. Liu and F.L. Lewis. Decentralized continuous robust controller for mobile 
robots. In Proceedings., IEEE International Conference on Robotics and Automation, 
pages 1822-1827, Cincinnati, OH, USA, 1990. IEEE Comput. Soc. Press. 


Laurent Lessard and Sanjay Lall. A state-space solution to the two-player 
decentralized optimal control problem. In 2011 49th Annual Allerton Confer- 
ence on Communication, Control, and Computing (Allerton), pages 1559-1564, 
Monticello, IL, September 2011. IEEE. 


Laurent Lessard and Sanjay Lall. Optimal Control of Two-Player Systems With 
Output Feedback. IEEE Transactions on Automatic Control, 60(8):2129-2144, 
August 2015. 


René Lamour, Roswitha Marz, and Caren Tischendorf. Differential-Algebraic 
Equations: A Projector Based Analysis. Springer Berlin Heidelberg, Berlin, 
Heidelberg, 2013. 


Santeri Lampinen, Jouni Niemi, and Jouni Mattila. Flow-Bounded Trajectory- 
Scaling Algorithm for Hydraulic Robotic Manipulators. In 2020 IEEE/ASME 
International Conference on Advanced Intelligent Mechatronics (AIM), pages 
619-624, Boston, MA, USA, July 2020. IEEE. 


Logitech. Logitech G920/G29 Force Feedback Steering Wheel, 2022. 


Boris Lohmann. Vollstandige Entkopplung durch dynamische Zustandsriick- 
führung / Complete decoupling by dynamic State feedback. auto, 39(1-12):459- 
464, December 1991. 


Kevin M. Lynch and Frank C. Park. Modern Robotics: Mechanics, Planning, and 
Control. Cambridge University Press, Cambridge, UK, 2017. 


LXXIV 


References 


[LSB21] 


[LSC* 19] 


[LSI18] 


[LTF*22] 


[Lud21] 


[Lun16] 


[LW95] 


[LWH*22] 


[Lww*21] 


[LYo2] 


[LYLC10] 


[LZ18] 


Cecilia Lindig-Leön, Gerrit Schmid, and Daniel A. Braun. Nash equilibria in 
human sensorimotor interactions explained by Q-learning with intrinsic costs. 
Scientific Reports, 11(1):20779, October 2021. 


Mingjun Li, Xiaolin Song, Haotian Cao, Jiangiang Wang, Yanjun Huang, Chuan 
Hu, and Hong Wang. Shared control with a novel dynamic authority allocation 
strategy based on game theory and driving safety field. Mechanical Systems 
and Signal Processing, 124:199-216, June 2019. 


Daniel Lakens, Anne M. Scheel, and Peder M. Isager. Equivalence Testing 
for Psychological Research: A Tutorial. Advances in Methods and Practices in 
Psychological Science, 1(2):259-269, 2018. 


Mushuang Liu, H. Eric Tseng, Dimitar Filev, Anouck Girard, and Ilya Kol- 
manovsky. Safe and Human-Like Autonomous Driving: A Predictor-Corrector 
Potential Game Approach. 2022. 


Julian Ludwig. Automatisierte kooperative Transition einer Regelungsaufgabe 
zwischen Mensch und Maschine am Beispiel des hochautomatisierten Fahrens. 
2021. 


Jan Lunze. Eigenschaften von linearen DAE-Systemen. at - Automatisierung- 
stechnik, 64(2):81-95, February 2016. 


Jen-Pei Liu and Chung-Sing Weng. Bias of two one-sided tests procedures in 
assessment of bioequivalence. Statistics in Medicine, 14(8):853-861, April 1995. 


Chao Liu, Hui Wang, Yu Huang, Youmin Rong, Jie Meng, Gen Li, and Guojun 
Zhang. Welding seam recognition and tracking for a novel mobile welding robot 
based on multi-layer sensing strategy. Measurement Science and Technology, 
33(5):055109, May 2022. 


Ruikun Luo, Yifan Weng, Yifan Wang, Paramsothy Jayakumar, Mark J. Brudnak, 
Victor Paul, Vishnu R. Desaraju, Jeffrey L. Stein, Tulga Ersal, and X. Jessie 
Yang. A workload adaptive haptic shared control scheme for semi-autonomous 
driving. Accident Analysis & Prevention, 152:105968, March 2021. 


C.K.-H. Law and Yangsheng Xu. Shared control for navigation and balance of 
a dynamically stable robot. In Proceedings 2002 IEEE International Conference 
on Robotics and Automation (Cat. No.02CH37292), volume 2, pages 1985-1990, 
Washington, DC, USA, 2002. IEEE. 


Yongjie Lu, Shaopu Yang, Shaohua Li, and Liqun Chen. Numerical and ex- 
perimental investigation on stochastic dynamic load of a heavy duty vehicle. 
Applied Mathematical Modelling, 34(10):2698-2710, October 2010. 


Yaning Lin and Weihai Zhang. Necessary/sufficient conditions for Pareto 
optimum in cooperative difference game: Necessary/sufficient conditions for 
Pareto optimum in cooperative difference game. Optimal Control Applications 
and Methods, 39(2):1043-1060, March 2018. 


References 


LXXV 


[LZD* 17] 


[MAD14] 


[MAD16] 


[Mar12] 


[MASD14] 


[MASMO05] 


[MB18] 


[MC12] 


[MCY09] 


[MG21] 


[MGF*21] 


[MHH20] 


Zhijun Li, Suna Zhao, Jiding Duan, Chun-Yi Su, Chenguang Yang, and Xingang 
Zhao. Human Cooperative Wheelchair With Brain-Machine Interaction Based 
on Shared Control Strategy. IEEE/ASME Transactions on Mechatronics, 22(1):185- 
195, February 2017. 


M. Mashali, R. Algasemi, and R. Dubey. Task priority based dual-trajectory con- 
trol for redundant mobile manipulators. In 2014 IEEE International Conference 
on Robotics and Biomimetics (ROBIO 2014), pages 1457-1462, Bali, Indonesia, 
December 2014. IEEE. 


Mustafa Mashali, Rdwan Alqasemi, and Rajiv Dubey. Mobile manipulator 
dual-trajectory tracking using control variables introduced to end-effector task 
vector. In 2016 World Automation Congress (WAC), pages 1-6, Rio Grande, PR, 
USA, July 2016. IEEE. 


Jason R. Marden. State based potential games. Automatica, 48(12):3075-3088, 
December 2012. 


Mustafa Mashali, Redwan Alqasemi, Sudeep Sarkar, and Rajiv Dubey. Design, 
implementation and evaluation of a motion control scheme for mobile platforms 
with high uncertainties. In 5th IEEE RAS/EMBS International Conference on 
Biomedical Robotics and Biomechatronics, pages 1091-1097, Sao Paulo, Brazil, 
August 2014. IEEE. 


B. M. Miller, K. E. Avrachenkov, K. V. Stepanyan, and G. B. Miller. Flow Control 
as a Stochastic Optimal Control Problem with Incomplete Information. Problems 
of Information Transmission, 41(2):150-170, April 2005. 


Jun Moon and Tamer Basar. Linear quadratic mean field Stackelberg differential 
games. Automatica, 97:200-213, November 2018. 


Constance A. Mara and Robert A. Cribbie. Paired-Samples Tests of Equivalence. 
Communications in Statistics - Simulation and Computation, 41(10):1928-1943, 
November 2012. 


Giacomo Marani, Song K. Choi, and Junku Yuh. Underwater autonomous 
manipulation for intervention missions AUVs. Ocean Engineering, 36(1):15-23, 
January 2009. 


Anil C Mahato and Sanjoy K Ghoshal. Energy-saving strategies on power 
hydraulic system: An overview. Proceedings of the Institution of Mechanical 
Engineers, Part I: Journal of Systems and Control Engineering, 235(2):147-169, 
February 2021. 


Maria Vittoria Minniti, Ruben Grandia, Kevin Fah, Farbod Farshidian, and 
Marco Hutter. Model Predictive Robot-Environment Interaction Control for 
Mobile Manipulation Tasks. In 2021 IEEE International Conference on Robotics 
and Automation (ICRA), pages 1651-1657, Xi’an, China, May 2021. IEEE. 


Xiangdong Meng, Yuqing He, and Jianda Han. Survey on Aerial Manipulator: 
System, Modeling, and Control. Robotica, 38(7):1288-1317, July 2020. 


LXXVI 


References 


[MHW*15] 


[MIF*20] 


[MKCS17] 


[MKK19] 


[MMRY12] 


[MOM94] 


[Mov22] 
[MRC19] 


[MS94] 


[MS96] 


[MTL10] 


[MUL20] 
[MWLH*11] 


Daniel Ortiz Morales, Pedro La Hera, Simon Westerberg, Leonid B. Freidovich, 
and Anton S. Shiriaev. Path-Constrained Motion Analysis: An Algorithm to 
Understand Human Performance on Hydraulic Manipulators. IEEE Transactions 
on Human-Machine Systems, 45(2):187-199, April 2015. 


Timothy L. Molloy, Jairo Inga, Michael Flad, Jason J. Ford, Tristan Perez, and 
Soren Hohmann. Inverse Open-Loop Noncooperative Differential Games and 
Inverse Optimal Control. IEEE Transactions on Automatic Control, 65(2):897-904, 
February 2020. 


Jouni Mattila, Janne Koivumaki, Darwin G. Caldwell, and Claudio Semini. A 
Survey on Control of Hydraulic Robotic Manipulators With Projection to Future 
Trends. IEEE/ASME Transactions on Mechatronics, 22(2):669-680, April 2017. 


M. Meiringer, A. Kugi, and W. Kemmetmiiller. Time-optimal fold out of large- 
scale manipulators with obstacle avoidance. IFAC-PapersOnLine, 52(16):114-119, 
2019. 


Aditya Mahajan, Nuno C. Martins, Michael C. Rotkowitz, and Serdar Yuksel. 
Information structures in optimal decentralized control. In 2012 IEEE 51st IEEE 
Conference on Decision and Control (CDC), pages 1291-1306, Maui, HI, USA, 
December 2012. IEEE. 


S. McMillan, D.E. Orin, and R.B. McGhee. Efficient dynamic simulation of an 
unmanned underwater vehicle with a manipulator. In Proceedings of the 1994 
IEEE International Conference on Robotics and Automation, pages 1133-1140, 
San Diego, CA, USA, 1994. IEEE Comput. Soc. Press. 


Yevgenii Movliev. Agriculture machinery, vector illustration, 2022. 


Federico Morosi, Marco Rossoni, and Giandomenico Caruso. Coordinated 
control paradigm for hydraulic excavator with haptic device. Automation in 
Construction, 105:102848, September 2019. 


Michael J. Massimino and Thomas B. Sheridan. Teleoperator Performance with 
Varying Force and Visual Feedback. Human Factors: The Journal of the Human 
Factors and Ergonomics Society, 36(1):145-157, March 1994. 


Dov Monderer and Lloyd S. Shapley. Potential Games. Games and Economic 
Behavior, 14(1):124-143, May 1996. 


Katja Mombaur, Anh Truong, and Jean-Paul Laumond. From human to hu- 
manoid locomotion—an inverse optimal control approach. Autonomous Robots, 
28(3):369-383, April 2010. 


MULAG. Produktübersicht: Arbeitsgeräte, April 2020. 
Daniel Ortiz Morales, Simon Westerberg, Pedro La Hera, Uwe Mettin, Leonid B. 
Freidovich, and Anton S. Shiriaev. Open-loop control experiments on driver 


assistance for crane forestry machines. In 2011 IEEE International Conference on 
Robotics and Automation, pages 1797-1802, Shanghai, China, May 2011. IEEE. 


References 


LXXVII 


[MYL91] 


[MZR* 14] 


[NC13] 


[NC22] 


[NGK15] 


[Nis07] 


[NMG05] 


[Nor10] 


[NP01] 


[NSP17] 


[NTM*20] 


[NW00] 


[NY96] 


H. Mahesh, J. Yuh, and R. Lakshmi. A coordinated control of an underwater 
vehicle and robotic manipulator. Journal of Robotic Systems, 8(3):339-370, June 
1991. 


Moshe P. Mann, Boaz Zion, Dror Rubinstein, Raphael Linker, and Itzhak Shmule- 
vich. Minimum Time Kinematic Motions of a Cartesian Mobile Manipulator 
for a Fruit Harvesting Robot. Journal of Dynamic Systems, Measurement, and 
Control, 136(5):051009, September 2014. 


Xiaoxiang Na and David J. Cole. Linear quadratic game and non-cooperative 
predictive methods for potential application to modelling driver-AFS interac- 
tive steering control. Vehicle System Dynamics, 51(2):165-198, February 2013. 


Xiaoxiang Na and David J. Cole. Experimental Evaluation of a Game-Theoretic 
Human Driver Steering Control Model. IEEE Transactions on Cybernetics, pages 
1-14, 2022. 


Alexandros Nikou, Georgios C. Gavridis, and Kostas J. Kyriakopoulos. Mechan- 
ical design, modelling and control of a novel aerial manipulator. In 2015 IEEE 
International Conference on Robotics and Automation (ICRA), pages 4698-4703, 
Seattle, WA, USA, May 2015. IEEE. 


Noam Nisan, editor. Algorithmic Game Theory. Cambridge University Press, 
Cambridge ; New York, 2007. 


S.S. Nudehi, R. Mukherjee, and M. Ghodoussi. A shared-control approach 
to haptic interface design for minimally invasive telesurgical training. IEEE 
Transactions on Control Systems Technology, 13(4):588-592, July 2005. 


Geoff Norman. Likert scales, levels of measurement and the “laws” of statistics. 
Advances in Health Sciences Education, 15(5):625-632, December 2010. 


Henk Norde and Fioravante Patrone. A potential approach for ordinal games. 
Top, 9(1):69-75, June 2001. 


Anh-Tu Nguyen, Chouki Sentouh, and Jean-Christophe Popieul. Driver- 
Automation Cooperative Approach for Shared Steering Control Under Multiple 
System Constraints: Design and Experiments. IEEE Transactions on Industrial 
Electronics, 64(5):3819-3830, May 2017. 


Jianjun Ni, Guangyi Tang, Zhengpei Mo, Weidong Cao, and Simon X. Yang. An 
Improved Potential Game Theory Based Method for Multi-UAV Cooperative 
Search. IEEE Access, 8:47787-47796, 2020. 


Jorge Nocedal and Stephen J. Wright. Numerical Optimization. Springer Series 
in Operations Research. Springer, New York, NY, corr. 2. print edition, 2000. 


Keiji Nagatani and Shin’ichi Yuta. Door-opening behavior of an autonomous 
mobile manipulator by sequence of action primitives. Journal of Robotic Systems, 
13(11):709-721, November 1996. 


LXXVII 


References 


[OGGL06] 


[OMA* 18] 


[OMS21a] 


[OMS21b] 


[ORA20] 


[Ort20] 


[OSBE11] 


[Ost20] 


[OTS* 22] 


[Par14] 


[PBLB06] 


[PCos] 


Marcia K. O’Malley, Abhishek Gupta, Matthew Gen, and Yanfang Li. Shared 
Control in Haptic Systems for Performance Enhancement and Training. Journal 
of Dynamic Systems, Measurement, and Control, 128(1):75-85, March 2006. 


Jessica S. Ortiz, Maria F. Molina, Victor H. Andaluz, Jose Varela, and Vicente 
Morales. Coordinated Control of a Omnidirectional Double Mobile Manipulator. 
In Kuinam J. Kim, Hyuncheol Kim, and Nakhoon Baek, editors, IT Convergence 
and Security 2017, volume 449, pages 278-286. Springer Singapore, Singapore, 
2018. 


Luiz F. P. Oliveira, Antonio P. Moreira, and Manuel F. Silva. Advances in Agri- 
culture Robotics: A State-of-the-Art Review and Challenges Ahead. Robotics, 
10(2):52, March 2021. 


Luiz F. P. Oliveira, Antönio P. Moreira, and Manuel F. Silva. Advances in Forest 
Robotics: A State-of-the-Art Survey. Robotics, 10(2):53, March 2021. 


ORAD - On-Road Automated Driving committee. Taxonomy and Definitions 
for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. 
Technical report, SAE International, March 2020. 


Albert R. Ortiz. Modeling Human-Structure Interaction Using a Controller System. 
Programa Editorial Universidad del Valle, first edition, December 2020. 


Patrick Opdenbosch, Nader Sadegh, Wayne Book, and Aaron Enes. Auto- 
calibration based control for independent metering of hydraulic actuators. In 
2011 IEEE International Conference on Robotics and Automation, pages 153-158, 
Shanghai, China, May 2011. IEEE. 


Julia Osterried. Betriebskosten der straßenverkehrsinfrastruktur als funktion von 
objekt- und netzeigenschaften. PhD thesis, Technische Universität München, 
Lehrstuhl für Bauprozessmanagement und Immobilienentwicklung, München, 
2020. 


Anibal Ollero, Marco Tognon, Alejandro Suarez, Dongjun Lee, and Antonio 
Franchi. Past, Present, and Future of Aerial Robotic Manipulators. IEEE Trans- 
actions on Robotics, 38(1):626-645, February 2022. 


Vilfredo Pareto. Manual of Political Economy: A Critical and Variorum Edition. 
OUP Oxford, 2014. 


Lúcio F. S. Patricio, Marcelo Becker, Janes Landre, and Clovis S. Barcellos. A 
New Vehicle 3D Model with 7 Degrees of Freedom for Vehicle Dynamical 
Response Studies. In C. A. Motasoares, J. A. C. Martins, H. C. Rodrigues, Jorge 
A. C. Ambrosio, C. A. B. Pina, C. M. Motasoares, E. B. R. Pereira, and J. Folgado, 
editors, I European Conference on Computational Mechanics, pages 773-773. 
Springer Netherlands, Dordrecht, 2006. 


Andrew J. Pick and David J. Cole. A Mathematical Model of Driver Steering 
Control Including Neuromuscular Dynamics. Journal of Dynamic Systems, 
Measurement, and Control, 130(3):031004, May 2008. 


References 


LXXIX 


[PCC+15] 


[PE07] 


[PF14] 


[PF16] 


[PLB15] 


[PLM+22] 


[P012] 


[PR18] 


[PSSL14] 


[PSv* 11] 


[RAA*17] 


M. Cody Priess, Richard Conway, Jongeun Choi, John M. Popovich, and Clark 
Radcliffe. Solutions to the Inverse LOR Problem With Application to Biological 
Systems Analysis. IEEE Transactions on Control Systems Technology, (2), 2015. 


Manfred Plöchl and Johannes Edelmann. Driver models in automobile dynamics 
application. Vehicle System Dynamics, 45(7-8):699-741, July 2007. 


Huynh Nhat Trinh Phan and Pal Johan From. Optimal base positioning for 
complex mobile manipulation tasks. In 2014 IEEE International Conference 
on Robotics and Biomimetics (ROBIO 2014), pages 1475-1480, Bali, Indonesia, 
December 2014. IEEE. 


Marie-Pierre Pacaux-Lemoine and Frank Flemisch. Layers of Shared and Coop- 
erative Control, assistance and automation. IFAC-PapersOnLine, 49(19):159-164, 
2016. 


Markos Papageörgiu, Marion Leibold, and Martin Buss. Optimierung: statische, 
dynamische, stochastische Verfahren fiir die Anwendung. Springer Vieweg, Berlin 
Heidelberg, 4., korrigierte auflage edition, 2015. 


Guillaume Picard, Roland Lenain, Youcef Mezouar, Benoit Thuilot, and Jean 
Laneurit. Multi-Trajectory Approach for a Generic Coordination Paradigm of 
Wheeled Mobile Manipulators. IEEE Robotics and Automation Letters, 7(2):2329- 
2336, April 2022. 


Dane Powell and Marcia K. O’Malley. The Task-Dependent Efficacy of Shared- 
Control Haptic Guidance Paradigms. IEEE Transactions on Haptics, 5(3):208-219, 
2012. 


Philipp Pasolli and Michael Ruderman. Linearized Piecewise Affine in Control 
and States Hydraulic System: Modeling and Identification. In IECON 2018 - 44th 
Annual Conference of the IEEE Industrial Electronics Society, pages 4537-4544, 
Washington, DC, October 2018. IEEE. 


Liam Paull, Sajad Saeedi, Mae Seto, and Howard Li. AUV Navigation and 
Localization: A Review. IEEE Journal of Oceanic Engineering, 39(1):131-149, 
January 2014. 


Jeroen Ploeg, Bart T. M. Scheepers, Ellen van Nunen, Nathan van de Wouw, 
and Henk Nijmeijer. Design and experimental evaluation of cooperative adap- 
tive cruise control. In 2011 14th International IEEE Conference on Intelligent 
Transportation Systems (ITSC), pages 260-265, Washington, DC, USA, October 
2011. IEEE. 


Morten H. Rudolfsen, Teodor N. Aune, Oddgeir Auklend, Leif Tore Aarland, 
and Michael Ruderman. Identification and control design for path tracking 
of hydraulic loader crane. In 2017 IEEE International Conference on Advanced 
Intelligent Mechatronics (AIM), pages 565-570, Munich, Germany, July 2017. 
IEEE. 


LXXX 


References 


[RE14] 


[Rec16] 


[RHV93] 


[Ril11] 
[RLO18] 


[Roo06] 


[Ros73] 


[Ros93] 


[RSV04] 


[Rud17] 


[Rud18] 


[RWIH20] 


Puduru Viswanadha Reddy and Jacob C. Engwerda. Necessary and Sufficient 
Conditions for Pareto Optimality in Infinite Horizon Cooperative Differential 
Games. IEEE Transactions on Automatic Control, 59(9):2536-2542, September 
2014. 


Rechnungshof, Baden Württemberg. Beratende Äußerung, Straßenbetriebsdi- 
enst an Landesstraßen, Bericht nach § 88 Absatz 2 Landeshaushaltsordnung, 
August 2016. 


James L. Rogers, Kenneth I. Howard, and John T. Vessey. Using significance 
tests to evaluate equivalence between two experimental groups. Psychological 
Bulletin, 113(3):553-565, 1993. 


Georg Rill. Road Vehicle Dynamics. CRC Press, zeroth edition, September 2011. 


Fabio Ruggiero, Vincenzo Lippiello, and Anibal Ollero. Aerial Manipulation: A 
Literature Review. IEEE Robotics and Automation Letters, 3(3):1957-1964, July 
2018. 


Ralf Roos, editor. Planung und Organisation von Arbeitsstellen kürzerer Dauer an 
Bundesautobahnen: Bericht zum Forschungsprojekt 03.362/2003/LGB: Empfehlun- 
gen zur Planung und Organisation von Arbeitsstellen kürzerer Dauer an Bunde- 
sautobahnen. Number 143 in Berichte der Bundesanstalt für Straßenwesen V, 
Verkehrstechnik. Wirtschaftsverl. NW, Verl. für Neue Wiss, Bremerhaven, 2006. 


Robert W. Rosenthal. A class of games possessing pure-strategy Nash equilibria. 
International Journal of Game Theory, 2(1):65-67, December 1973. 


L.B. Rosenberg. Virtual fixtures: Perceptual tools for telerobotic manipulation. 
In Proceedings of IEEE Virtual Reality Annual International Symposium, pages 
76-82, Seattle, WA, USA, 1993. IEEE. 


Dinah Rosenberg, Eilon Solan, and Nicolas Vieille. Stochastic Games with a 
Single Controller and Incomplete Information. SIAM Journal on Control and 
Optimization, 43(1):86-110, January 2004. 


Michael Ruderman. Full- and reduced-order model of hydraulic cylinder for 
motion control. In IECON 2017 - 43rd Annual Conference of the IEEE Industrial 
Electronics Society, pages 7275-7280, Beijing, October 2017. IEEE. 


Michael Ruderman. Minimal-model for robust control design of large-scale 
hydraulic machines. In 2018 IEEE 15th International Workshop on Advanced 
Motion Control (AMC), pages 397-401, Tokyo, March 2018. IEEE. 


Simon Rothfus, Maximilian Worner, Jairo Inga, and Soren Hohmann. A Study 
on Human-Machine Cooperation on Decision Level. In 2020 IEEE International 
Conference on Systems, Man, and Cybernetics (SMC), pages 2291-2298, Toronto, 
ON, Canada, October 2020. IEEE. 


References 


LXXXI 


[RXY*17] 


[SCO*18] 


[Sd13] 


[SG01] 


[She18] 


[Shi11] 
[SK08a] 


[SKosb] 


[SLB*98] 


[SLL*19] 


[SLO*22] 


Shunan Ren, Ying Xie, Xiangdong Yang, Jing Xu, Guolei Wang, and Ken Chen. A 
Method for Optimizing the Base Position of Mobile Painting Manipulators. IEEE 
Transactions on Automation Science and Engineering, 14(1):370-375, January 
2017. 


Satja Sivéev, Joseph Coleman, Edin Omerdić, Gerard Dooly, and Daniel Toal. Un- 
derwater manipulators: A review. Ocean Engineering, 163:431-450, September 
2018. 


Thomas Stanger and Luigi del Re. A model predictive Cooperative Adaptive 
Cruise Control approach. In 2013 American Control Conference, pages 1374-1379, 
Washington, DC, June 2013. IEEE. 


Micah Steele and R. Brent Gillespie. Shared Control between Human and Ma- 
chine: Using a Haptic Steering Wheel to Aid in Land Vehicle Guidance. Proceed- 
ings of the Human Factors and Ergonomics Society Annual Meeting, 45(23):1671- 
1675, October 2001. 


Dong Shen. Iterative learning control with incomplete information: A survey. 
IEEE/CAA Journal of Automatica Sinica, 5(5):885-901, September 2018. 


Pete Shinners. Pygame, 2011. 


Bruno Siciliano and Oussama Khatib, editors. Springer Handbook of Robotics. 
Springer, Berlin, 2008. 


Hao Su and Venkat Krovi. Decentralized Dynamic Control of a Nonholonomic 
Mobile Manipulator Collective: A Simulation Study. In ASME 2008 Dynamic 
Systems and Control Conference, Parts A and B, pages 661-668, Ann Arbor, 
Michigan, USA, 2008. ASME. 


Richard C. Simpson, Simon P. Levine, David A. Bell, Lincoln A. Jaros, Yoram 
Koren, and Johann Borenstein. NavChair: An assistive wheelchair naviga- 
tion system with automatic adaptation. In Vibhu O. Mittal, Holly A. Yanco, 
John Aronis, and Richard Simpson, editors, Assistive Technology and Artificial 
Intelligence, volume 1458, pages 235-255. Springer-Verlag, Berlin/Heidelberg, 
1998. 


Dong-ik Sun, Sang-keun Lee, Yong-seok Lee, Sang-ho Kim, Jun Ueda, Yong K 
Cho, Yong-han Ahn, and Chang-soo Han. Assessments of intuition and effi- 
ciency: Remote control of the end point of excavator in operational space by 
using one wrist. In Computing in Civil Engineering 2019: Data, Sensing, and 
Analytics-Selected Papers from the ASCE International Conference on Computing 
in Civil Engineering 2019, pages 273-280. American Society of Civil Engineers 
(ASCE), 2019. 


Eito Sato, Hailong Liu, Yasuaki Orita, Norimitsu Sakagami, and Takahiro Wada. 
Cooperative path-following control of a remotely operated underwater vehicle 
for human visual inspection task. Frontiers in Control Engineering, 3:1056937, 
December 2022. 


LXXXII 


References 


[SMK20] 


[SNBP19] 


[SOC21] 


[SP01] 


[SRGFS19] 


[SRH22] 


[SS20] 


[SSK17] 


[SSK*22] 


[Ste11] 


[Stu99] 


[SW65] 


[Tad13] 


Brian Swenson, Ryan Murray, and Soummya Kar. Regular potential games. 
Games and Economic Behavior, 124:432-453, November 2020. 


Chouki Sentouh, Anh-Tu Nguyen, Mohamed Amir Benloucif, and Jean- 
Christophe Popieul. Driver-Automation Cooperation Oriented Approach for 
Shared Control of Lane Keeping Assist Systems. IEEE Transactions on Control 
Systems Technology, 27(5):1962-1978, September 2019. 


Satoru Sakai, Masaki Obara, and Kenta Chikazawa. Parameter identification 
via nominal integrator of hydraulic cylinder dynamics. IFAC-PapersOnLine, 
54(14):78-83, 2021. 


N. Sarkar and T.K. Podder. Coordinated motion planning and control of au- 
tonomous underwater vehicle-manipulator systems subject to drag optimiza- 
tion. IEEE Journal of Oceanic Engineering, 26(2):228-239, April 2001. 


M. Selvaggio, P. Robuffo Giordano, F. Ficuciello, and B. Siciliano. Passive 
Task-Prioritized Shared-Control Teleoperation with Haptic Guidance. In 2019 
International Conference on Robotics and Automation (ICRA), pages 430-436, 
Montreal, QC, Canada, May 2019. IEEE. 


Julian Schneider, Simon Rothfuß, and Sören Hohmann. Negotiation-based 
cooperative planning of local trajectories. Frontiers in Control Engineering, 
3:1058980, November 2022. 


Jiazhi Song and Inna Sharf. Time Optimal Motion Planning with ZMP Stability 
Constraint for Timber Manipulation. In 2020 IEEE International Conference on 
Robotics and Automation (ICRA), pages 4934-4940, Paris, France, May 2020. 
IEEE. 


Pramen P. Shrestha, Kabindra K. Shrestha, and Thomas K. Kandie. Effects of 
Change Orders on the Cost and Schedule of Rural Road Maintenance Projects. 
Journal of Legal Affairs and Dispute Resolution in Engineering and Construction, 
9(3):04517010, August 2017. 


Norimitsu Sakagami, Mizuki Suka, Yu Kimura, Eito Sato, and Takahiro Wada. 
Haptic shared control applied for ROV operation support in flowing water. 
Artificial Life and Robotics, August 2022. 


Kim A Stelson. Saving the world’s energy with fluid power. In Proc. of the 8th 
JFPS International Symposium on Fluid Power, volume 15, 2011. 


Jos F. Sturm. Using SeDuMi 1.02, A Matlab toolbox for optimization over 
symmetric cones. Optimization Methods and Software, 11(1-4):625-653, January 
1999. 


S. S. Shapiro and M. B. Wilk. An Analysis of Variance Test for Normality 
(Complete Samples). Biometrika, 52(3/4):591, December 1965. 


Steve Tadelis. Game Theory: An Introduction. Princeton University Press, 
Princeton; Oxford, 2013. 


References 


LXXXIII 


[Tah01] 


[TAT11] 


[Tat18] 


[TFSG18] 


[THY12] 


[TJ02] 


[TK01] 


[TKM18] 


[TEX*17] 


[TMK*08] 


[TMK*11] 


[Tod04] 


[TPF21] 


K.A. Tahboub. Natural and manmade shared-control systems: An overview. In 
Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation 
(Cat. No.01CH37164), volume 3, pages 2655-2660, Seoul, South Korea, 2001. IEEE. 


Seyed Hossein Tamaddoni, Mehdi Ahmadian, and Saied Taheri. Optimal vehicle 
stability control design based on preview game theory concept. In Proceedings 
ofthe 2011 American Control Conference, pages 5249-5254, San Francisco, CA, 
June 2011. IEEE. 


Tatiana Tatarenko. Stochastic Learning in Potential Games: Communication 
and Payoff-Based Approaches. 2018. 


Shantanu Thakar, Liwei Fang, Brual Shah, and Satyandra Gupta. Towards 
Time-Optimal Trajectory Planning for Pick-and-Transport Operation with a 
Mobile Manipulator. In 2018 IEEE 14th International Conference on Automation 
Science and Engineering (CASE), pages 981-987, Munich, Germany, August 2018. 
IEEE. 


Xuan Bo Tran, Nur Hafızah, and Hideki Yanada. Modeling of dynamic friction 
behaviors of hydraulic cylinders. Mechatronics, 22(1):65-75, February 2012. 


Emanuel Todorov and Michael I. Jordan. Optimal feedback control as a theory 
of motor coordination. Nature Neuroscience, 5(11):1226-1235, November 2002. 


Herbert G. Tanner and Kostas J. Kyriakopoulos. Mobile manipulator modeling 
with Kanes approach. Robotica, 19(6):675-690, September 2001. 


C. Ton, Z. Kan, and S. S. Mehta. Obstacle avoidance control of a human- 
in-the-loop mobile robot system using harmonic potential fields. Robotica, 
36(4):463-483, April 2018. 


Qirong Tang, Le Liang, Jianhua Xie, Yinghao Li, and Zhengiang Deng. Task- 
priority redundancy resolution on acceleration level for underwater vehicle- 
manipulator system. International Journal of Advanced Robotic Systems, 
14(4):172988141771982, July 2017. 


Chin Pei Tang, Patrick T Miller, Venkat N Krovi, Ji-Chul Ryu, and Sunil K 
Agrawal. Kinematic Control of aNonholonomic Wheeled Mobile Manipulator: 
A Differential Flatness Approach. page 8, 2008. 


Chin Pei Tang, Patrick T. Miller, Venkat N. Krovi, Ji-Chul Ryu, and Sunil K. 
Agrawal. Differential-Flatness-Based Planning and Control of a Wheeled Mobile 
Manipulator—Theory and Experiment. IEEE/ASME Transactions on Mechatron- 
ics, 16(4):768-773, August 2011. 


Emanuel Todorov. Optimality principles in sensorimotor control. Nature 
Neuroscience, 7(9):907-915, September 2004. 


Felix Top, Sebastian Pütz, and Johannes Fottner. Human-Centered HMI for 
Crane Teleoperation: Intuitive Concepts Based on Mental Models, Compatibility 
and Mental Workload. In Don Harris and Wen-Chin Li, editors, Engineering 


LXXXIV 


References 


[TSA*22] 


[UP05] 


[VA19] 


[VB99] 


[VGJ19] 


[VN97] 


[V0000] 


[vS*52] 


[Wad19] 


[War05] 


[WBK07] 


[wcso] 


[wDZ*20] 


[WEB15] 


Psychology and Cognitive Ergonomics, volume 12767, pages 438-456. Springer 
International Publishing, Cham, 2021. 


Shantanu Thakar, Srivatsan Srinivasan, Sarah Al-Hussaini, Prahar Bhatt, 
Pradeep Rajendran, Yeo Jung Yoon, Neel Dhanaraj, Rishi K. Malhan, Matthias 
Schmid, Venkat Krovi, and Satyandra K. Gupta. A Survey of Wheeled Mobile 
Manipulation: A Decision Making Perspective. Journal of Mechanisms and 
Robotics, pages 1-38, May 2022. 


Ay Ungoren and H Peng. An adaptive lateral preview driver model. Vehicle 
System Dynamics, 43(4):245-259, April 2005. 


J. P. Verma and Abdel-Salam G. Abdel-Salam. Testing Statistical Assumptions in 
Research. John Wiley & Sons, Hoboken, NJ, 2019. 


Dirk Vorberg and Sven Blankenberger. Die Auswahl statistischer Tests und 
Maße. Psychologische Rundschau, 50(3):157-164, July 1999. 


J. Jaidev Vyas, Balamurugan Gopalsamy, and Harshavardhan Joshi. Electro- 
Hydraulic Actuation Systems: Design, Testing, Identification and Validation. 
SpringerBriefs in Applied Sciences and Technology. Springer Singapore, Singa- 
pore, 2019. 


Mark Voorneveld and Henk Norde. A Characterization of Ordinal Potential 
Games. Games and Economic Behavior, 19(2):235-242, May 1997. 


Mark Voorneveld. Best-response potential games. Economics Letters, 66(3):289- 
295, March 2000. 


Heinrich von Stackelberg et al. Theory of the market economy. 1952. 


Takahiro Wada. Simultaneous achievement of driver assistance and skill de- 
velopment in shared and cooperative controls. Cognition, Technology & Work, 
21(4):631-642, November 2019. 


William P. Wardlaw. Row Rank Equals Column Rank. Mathematics Magazine, 
78(5):316-318, December 2005. 


Glenn D. White, Rajankumar M. Bhatt, and Venkat N. Krovi. Dynamic redun- 
dancy resolution in a nonholonomic wheeled mobile manipulator. Robotica, 
25(2):147-156, March 2007. 


Earl L. Wiener and Renwick E. Curry. Flight-deck automation: Promises and 
problems. Ergonomics, 23(10):995-1011, November 1980. 


Isabell Wochner, Danny Driess, Heiko Zimmermann, Daniel F. B. Haeufle, Marc 
Toussaint, and Syn Schmitt. Optimality Principles in Human Point-to-Manifold 
Reaching Accounting for Muscle Dynamics. Frontiers in Computational Neuro- 
science, 14:38, May 2020. 


Ryder C. Winck, Mark Elton, and Wayne J. Book. A practical interface for 
coordinated position control of an excavator arm. Automation in Construction, 
51:46-58, March 2015. 


References 


LXXXV 


[Wel10] 


[WFK* 16] 


[WHEB*18] 


[WKK20] 


[WLA*02] 


[WN11] 


[WTES87] 


[wwos] 


[wwxs22] 


[XC18] 


[XWCH22] 


Stefan Wellek. Testing Statistical Hypotheses of Equivalence and Noninferiority. 
Chapman and Hall/CRC, zeroth edition, June 2010. 


Melonee Wise, Michael Ferguson, Derek King, Eric Diehr, and David Dymesich. 
Fetch and freight: Standard platforms for service robot applications. In Work- 
shop on Autonomous Mobile Service Robots, 2016. 


Maria Wirzberger, Robert Herms, Shirin Esmaeili Bijarsari, Maximilian Eibl, 
and Günter Daniel Rey. Schema-related cognitive load influences performance, 
speech, and physiology in a dual-task setting: A continuous multi-measure 
approach. Cognitive Research: Principles and Implications, 3(1):46, December 
2018. 


Robert Wirth, Iring Koch, and Wilfried Kunde. Localizing modality compati- 
bility effects: Evidence from dual-task interference. Journal of Experimental 
Psychology: Human Perception and Performance, 46(12):1527-1537, December 
2020. 


L.E.P. Williams, R.B. Loftin, H.A. Aldridge, E.L. Leiss, and WJ. Bluethmann. 
Kinesthetic and visual force display for telerobotics. In Proceedings 2002 IEEE 
International Conference on Robotics and Automation (Cat. No.02CH37292), vol- 
ume 2, pages 1249-1254, Washington, DC, USA, 2002. IEEE. 


Esteban Walker and Amy S. Nowacki. Understanding Equivalence and Nonin- 
feriority Testing. Journal of General Internal Medicine, 26(2):192-196, February 
2011. 


Won Kim, F. Tendick, S. Ellis, and L. Stark. A comparison of position and 
rate control for telemanipulations with consideration of manipulator system 
dynamics. IEEE Journal on Robotics and Automation, 3(5):426-436, October 
1987. 


Jens Wittenburg and Jens Wittenburg. Dynamics of Multibody Systems. Springer, 
Berlin ; New York, 2nd ed edition, 2008. 


Jiaming Wu, Feng Wang, Bing Xu, and Zongxuan Sun. Characteristics study of 
electro-hydraulic load-sensing control system for mobile machines. Proceed- 
ings of the Institution of Mechanical Engineers, Part D: Journal of Automobile 
Engineering, page 095440702211053, June 2022. 


Bing Xu and Min Cheng. Motion control of multi-actuator hydraulic systems 
for mobile machineries: Recent advancements and future trends. Frontiers of 
Mechanical Engineering, 13(2):151-166, June 2018. 


Yintao Xu, Tao Wang, Chong Chen, and Bo Hu. Learning Collision-freed 
Trajectory of welding manipulator based on Safe Reinforcement Learning. In 
2022 IEEE 18th International Conference on Automation Science and Engineering 
(CASE), pages 836-841, Mexico City, Mexico, August 2022. IEEE. 


LXXXVI 


References 


[YAF*99] 


[YM10] 


[YTO*19] 


[YVF17] 


[YYF22] 


[YZC22] 


[ZANS06] 


[ZGSF09] 


[Zha03] 


[ZKHE13] 


[ZMZ*21] 


M. Yoneda, F. Arai, T. Fukuda, K. Miyata, and T. Niato. Assistance system for 
crane operation with haptic display - operational assistance to suppress round 
payload swing. In Proceedings 1999 IEEE International Conference on Robotics 
and Automation (Cat. No.99CH36288C), volume 4, pages 2924-2929, Detroit, MI, 
USA, 1999. IEEE. 


Jungwon Yoon and Auralius Manurung. Development of an intuitive user 
interface for a hydraulic backhoe. Automation in Construction, 19(6):779-790, 
October 2010. 


Takashi Yamamoto, Koji Terada, Akiyoshi Ochiai, Fuminori Saito, Yoshiaki 
Asahara, and Kazuto Murase. Development of Human Support Robot as the 
research platform of a domestic mobile manipulator. ROBOMECH Journal, 
6(1):4, December 2019. 


I Yung, Carlos Vazquez, and Leonid B. Freidovich. Robust position control 
design for a cylinder in mobile hydraulics applications. Control Engineering 
Practice, 69:36-49, December 2017. 


Chuan Yan, Tao Yang, and Huazhen Fang. High-Order Leader-Follower Track- 
ing Control under Limited Information Availability. 2022. 


Canjun Yang, Yuanchao Zhu, and Yanhu Chen. A Review of Human-Machine 
Cooperation in the Robotics Domain. IEEE Transactions on Human-Machine 
Systems, 52(1):12-25, February 2022. 


Zhijun Li, Aiguo Ming, Ning Xi, and M. Shimojo. Motion control of nonholo- 
nomic mobile underactuated manipulator. In Proceedings 2006 IEEE International 
Conference on Robotics and Automation, 2006. ICRA 2006., pages 3512-3519, Or- 
lando, FL, USA, 2006. IEEE. 


Kurosh Zarei-nia, Amin Yazdanpanah Goharrizi, Nariman Sepehri, and Wai- 
keung Fung. Experimental evaluation of bilateral control schemes applied to 
hydraulic actuators: A comparative study. Transactions of the Canadian Society 
for Mechanical Engineering, 33(3):377-398, September 2009. 


Paul Zhang. A Simple Formula for Sample Size Calculation in Equivalence 
Studies. Journal of Biopharmaceutical Statistics, 13(3):529-538, January 2003. 


Guoliang Zhong, Yukinori Kobayashi, Yohei Hoshino, and Takanori Emaru. 
System modeling and tracking control of mobile manipulator subjected to 
dynamic interaction and uncertainty. Nonlinear Dynamics, 73(1-2):167-182, 
July 2013. 


Zhe Zhou, Scott J. Moura, Hongcai Zhang, Xuan Zhang, Qinglai Guo, and 
Hongbin Sun. Power-traffic network equilibrium incorporating behavioral 
theory: A potential game perspective. Applied Energy, 289:116703, May 2021. 


References 


LXXXVII 


[ZSS* 20] 


[ZYZS19] 


[ZZLW19] 


[ZZZ14] 


Heng Zhang, Qi Sheng, Yuxin Sun, Xinjun Sheng, Zhenhua Xiong, and Xi- 
angyang Zhu. A novel coordinated motion planner based on capability map for 
autonomous mobile manipulator. Robotics and Autonomous Systems, 129:103554, 
July 2020. 


Shuhang Zhang, Jiadi Yang, Hongliang Zhang, and Lingyang Song. Dual Tra- 
jectory Optimization for a Cooperative Internet of UAVs. IEEE Communications 
Letters, 23(6):1093-1096, June 2019. 


Yuanheng Zhu, Dongbin Zhao, Xiangjun Li, and Ding Wang. Control-Limited 
Adaptive Dynamic Programming for Multi-Battery Energy Storage Systems. 
IEEE Transactions on Smart Grid, 10(4):4235-4244, July 2019. 


Yong-An Zhang, Zhi-Gang Zhou, and Di Zhou. A geometric approach for 
modelling of unfixed-base manipulators. In 2014 IEEE International Conference 
on Robotics and Biomimetics (ROBIO 2014), pages 2535-2540, Bali, Indonesia, 
December 2014. IEEE. 


LXXXVII 


References 


Own Publications and Conference Contributions 


[BHF*23] 


[VBSH20] 


[VDTH22] 


[VH22] 


[VHH23] 


[VIH21] 


[VIH22] 


[VILH21] 


[VMH22] 


[VMSH19] 


[VRH22] 


Christian A. Braun, Ludwig Haide, Lars Fischer, Sean Kille, Balint Varga, Simon 
Rothfuss, and Sören Hohmann. Using a Collaborative Robotic Arm as Human- 
Machine Interface: System Setup and Application to Pose Control Tasks. In 2023 
IEEE International Conference on Robotics and Automation (ICRA), London , UK, 
May 2023. IEEE. 


Balint Varga, Yannick Burkhardt, Stefan Schwab, and Sören Hohmann. Shared- 
Control Concepts for Large Vehicle-Manipulators. In 29th IEEE International Sym- 
posium on Industrial Electronics, Delft, The Netherlands, 2020. 


Balint Varga, Christopher Doer, Gert F. Trommer, and Sören Hohmann. Validation 
of a Limit Ellipsis Controller for Rescue Drones. In 2022 IEEE 16th International 
Symposium on Applied Computational Intelligence and Informatics (SACI), pages 
55-60, Timisoara, Romania, May 2022. IEEE. 


Balint Varga and Sören Hohmann. Limited Information Longitudinal Shared Control 
of Large Vehicle-Manipulator. IFAC-PapersOnLine, 55(29):43-48, 2022. 


Balint Varga, Da Huang, and Sören Hohmann. Identification Methods for Ordi- 
nal Potential Differential Games, 2023. preprint https: //doi.org/10.48550/ 
arXiv. 2306.12963. 


Balint Varga, Jairo Inga, and Sören Hohmann. Personalized Design and Exper- 
imental Validation of a Limited Information Cooperative Shared-Controller for 
Vehicle-Manipulators. In 2021 IEEE International Conference on Systems, Man, and 
Cybernetics (SMC), pages 1489-1494, Melbourne, Australia, October 2021. IEEE. 


Balint Varga, Jairo Inga, and Sören Hohmann. Limited Information Shared Control: 
A Potential Game Approach. IEEE Transactions on Human-Machine Systems, October 
2022. 


Balint Varga, Jairo Inga, Markus Lemmer, and Soren Hohmann. Ordinal Potential 
Differential Games to Model Human-Machine Interaction in Vehicle-Manipulators. 
In 2021 IEEE Conference on Control Technology and Applications (CCTA), pages 
728-734, San Diego, CA, USA, August 2021. IEEE. 


Balint Varga, Selina Meier, and Sören Hohmann. Development of a Mobile Vehicle 
Manipulator Simulator for the Validation of Shared Control Concepts. In FDIBA 
Conference Proceedings, volume 6, Nov. 2022. 


Balint Varga, Selina Meier, Stefan Schwab, and Sören Hohmann. Model Predictive 
Control and Trajectory Optimization of Large Vehicle-Manipulators. In 2019 IEEE 
International Conference on Mechatronics (ICM), pages 60-66, Ilmenau, Germany, 
March 2019. IEEE. 


Balint Varga, Simon Rothfuß, and Sören Hohmann. Validation of a Limited Informa- 
tion Shared Controller: A Comparative Study. In 2022 IEEE International Conference 
on Systems, Man, and Cybernetics (SMC), pages 949-954. IEEE, 2022. 


References 


LXXXIX 


[VSB*20] 


[VSL*20] 


[VSSH19] 


Balint Varga, Arash Shahirpour, Yannick Burkhardt, Stefan Schwab, and Sören 
Hohmann. Validation of Cooperative Shared-Control Concepts for Large Vehicle- 
Manipulators. In 2020 IEEE Conference on Control Technology and Applications 
(CCTA), pages 542-548, Montreal, QC, Canada, August 2020. IEEE. 


Balint Varga, Arash Shahirpour, Markus Lemmer, Stefan Schwab, and Sören 
Hohmann. Limited-Information Cooperative Shared Control for Vehicle- 
Manipulators. In 2020 IEEE International Conference on Systems, Man, and Cy- 
bernetics (SMC), pages 4431-4438, Toronto, ON, Canada, October 2020. IEEE. 


Balint Varga, Arash Shahirpour, Stefan Schwab, and Sören Hohmann. Control of 
Large Vehicle-Manipulators with Human Operator. IFAC-PapersOnLine, 52(30):373- 
378, 2019. 


XC 


References 


Supervised Bachelor’s and Master’s theses 


[Bou19] 


[Bur19] 


[Gas20] 


[Hua21] 


[Liu19] 


[Mai18] 


[Sha19] 


[Ste19] 


[Wun19] 


Mohamed Khalil Bouzidi. Simulation und Realisierung einer Roboterarmregelung für 
eine Arbeitsmaschine. Bachelor thesis, Institute of Control Systems (IRS), Karlsruhe 
Institute of Technology (KIT), 2019. 


Yannick Burkhardt. Shared Control Konzepte für mobile Arbeitsmaschinen. Bache- 
lorarbeit, Institute of Control Systems (IRS), Karlsruhe Institute of Technology (KIT), 
2019. 


Indrit Gashi. Weiterentwicklung eines 6-Freiheitsgrade-Joysticks. Bachelorarbeit, 
Institute of Control Systems (IRS), Karlsruhe Institute of Technology (KIT), 2020. 


Da Huang. Identification of Cooperative Control Systems Based on the Theory of 
Dynamic Potential Games. Masterarbeit, Institute of Control Systems (IRS), Karlsruhe 
Institute of Technology (KIT), 2021. 


Jianan Liu. Conception and Realization of a 6 DOF Force-Feedback Joystick for 
Robotic Arm Control. Masterarbeit, Institute of Control Systems (IRS), Karlsruhe 
Institute of Technology (KIT), 2019. 


Selina Maier. Simulation und modellprädiktive Regelung einer mobilen Arbeits- 
maschine. Master thesis, Institute of Control Systems (IRS), Karlsruhe Institute of 
Technology (KIT), 2018. 


Arash Shahirpour. Cooperative Control of a Utility Vehicle with a Robotic Arm. 
Masterarbeit, Institute of Control Systems (IRS), Karlsruhe Institute of Technology 
(KIT), 2019. 


Christian Steinhauser. Kooperative Regelung eines hydraulischen Roboterarms 
für eine mobile Arbeitsmaschine. Masterarbeit, Institute of Control Systems (IRS), 
Karlsruhe Institute of Technology (KIT), 2019. 


Klara Wund. Erweiterung und bildbasierte Regelung eines autonomen Demonstra- 
torfahrzeugs mit einem Roboterarm. Bachelorarbeit, Institute of Control Systems 
(IRS), Karlsruhe Institute of Technology (KIT), 2019. 


Karlsruher Beiträge zur Regelungs- und Steuerungstechnik (ISSN 2511-6312) 
Institut für Regelungs- und Steuerungssysteme 


Band 01 


Band 02 


Band 03 


Band 04 


Band 05 


Band 06 


Band 07 


Band 08 


Diehm, Gunter 

Identifikation des menschlichen Bewegungsverhaltens 
auf der Basis von Primitiven. 

ISBN 978-3-7315-0608-9 


Flad, Michael 

Kooperative Regelungskonzepte auf Basis der Spieltheorie 
und deren Anwendung auf Fahrerassistenzsysteme. 

ISBN 978-3-7315-0610-2 


Eckert, Marius 

Modellbasierte Identifikation fraktionaler Systeme 
und ihre Anwendung auf die Lithium-lonen-Zelle. 
ISBN 978-3-7315-0690-4 


Krebs, Stefan 

Intervallbeobachter für lineare parametervariante Systeme 
und deren Anwendung auf die Asynchronmaschine. 

ISBN 978-3-7315-0857-1 


Kaspar, Stephan 

Fahrdynamikuntersuchungen eines Elektrofahrzeugs 
mit Einzelrad-Hinterradantrieb. 

ISBN 978-3-7315-0916-5 


Sauter, Patrick S. 

Modellierung und zentrale prädiktive Regelung 
von multimodalen Energieverteilnetzen. 

ISBN 978-3-7315-0963-9 


Kupper, Martin 

Verteilte Zustandsschätzung fraktionaler Systeme und 
ihre Anwendung auf Lithium-lonen-Batteriesysteme. 
ISBN 978-3-7315-0971-4 


Merkert, Lennart 

Optimal Scheduling of Combined Heat and Power Generation 
Considering Heating Grid Dynamics. 

ISBN 978-3-7315-1056-7 


Die Bände sind unter www.ksp.kit.edu als PDF frei verfügbar oder als Druckausgabe bestellbar. 


Band 09 


Band 10 


Band 11 


Band 12 


Band 13 


Band 14 


Band 15 


Band 16 


Ludwig, Julian 

Automatisierte kooperative Transition einer Regelungsaufgabe 
zwischen Mensch und Maschine am Beispiel des hochautomati- 
sierten Fahrens. 

ISBN 978-3-7315-1069-7 


Inga Charaja, Juan Jairo 

Inverse Dynamic Game Methods for Identification 
of Cooperative System Behavior. 

ISBN 978-3-7315-1080-2 


Schnurr, Christoph Xaver 

Ein Verfahren zur lexikographischen modellprädiktiven 
Regelung mit der Anwendung auf eine permanenterregte 
Synchronmaschine. 

ISBN 978-3-7315-1095-6 


Schwab, Stefan 
Guaranteed Verification of Dynamic Systems. 
ISBN 978-3-7315-0965-3 


Pfeifer, Martin 

Automated Model Generation and Observer Design for 
Interconnected Systems: A Port-Hamiltonian Approach. 
ISBN 978-3-7315-1135-9 


König, Alexander 

Absicherung hochautomatisierten Fahrens durch 
passiven virtuellen Dauerlauftest. 

ISBN 978-3-7315-1141-0 


Stark, Oliver 

Parameter- und Ordnungsidentifikation von 
fraktionalen Systemen mit einer Anwendung 
auf eine Lithium-lonen-Batteriezelle. 

ISBN 978-3-7315-1187-8 


Kopf, Florian 

Adaptive Dynamic Programming: 
Solltrajektorienfolgeregelung und Konvergenzbedingungen. 
ISBN 978-3-7315-1193-9 


Die Bande sind unter www.ksp.kit.edu als PDF frei verfügbar oder als Druckausgabe bestellbar. 


Band 17 Kölsch, Lukas 
Dynamic Incentives for Optimal Control of 
Competitive Power Systems. 
ISBN 978-3-7315-1209-7 


Band 18 Schwartz, Manuel 
Topologie-Optimierung eines radselektiv 
angesteuerten Fahrzeugs basierend auf 
einer optimalen Fahrzeugführungsregelung. 
ISBN 978-3-7315-1222-6 


Band 19 Rothfuß, Simon 
Human-Machine Cooperative Decision Making. 
ISBN 978-3-7315-1223-3 


Band 20 Gellrich, Thomas Christoph 
Dynamical Modeling and Control of Multiphase 
Heat Transport Systems Based on Loop Heat Pipes. 
ISBN 978-3-7315-1231-8 


Band 21 Maurer, Jona 
Transactive Control of Coupled Electric Power 
and District Heating Networks. 
ISBN 978-3-7315-1276-9 


Band 22 Puccetti, Luca 
Self-Learning Longitudinal Control for On-Road Vehicles. 
ISBN 978-3-7315-1290-5 


Band 23 Varga, Balint 
Limited Information Shared Control and its Applications 
to Large Vehicle Manipulators. 
ISBN 978-3-7315-1325-4 


Die Bände sind unter www.ksp.kit.edu als PDF frei verfügbar oder als Druckausgabe bestellbar. 


| RS INSTITUT FUR REGELUNGS- UND 23 
STEUERUNGSSYSTEME 


This work focuses on shared control for large vehicle manipulators used in unstructured 
environments like road maintenance. The proposed approach automates the vehicle while 
allowing human operators to control the manipulator. This unique shared control setup ex- 
plores limited information sharing between the two subsystems, where the automation lacks 
information about the manipulator. Furthermore, the book introduces a systematic design 
method for concept of limited information shared control, utilizing two new subclasses of 


potential games for parameter calculation. The shared control concept is applied and tested 
on a large vehicle manipulator through simulations and human-in-the-loop experiments, 
demonstrating superior performance over manual and non-cooperative control setups. Thus, 
the practical applicability and benefits of shared control for large vehicle manipulators are 
highlighted in this book. 


1325-4 


ISSN 2511-6312 | | | 
ISBN 978-3-7315-1325-4 9 1783731513254 


Gedruckt auf FSC-zertifiziertem Papier 


